CN108038783B - Position management method, system and computer readable storage medium - Google Patents
Position management method, system and computer readable storage medium Download PDFInfo
- Publication number
- CN108038783B CN108038783B CN201711363368.4A CN201711363368A CN108038783B CN 108038783 B CN108038783 B CN 108038783B CN 201711363368 A CN201711363368 A CN 201711363368A CN 108038783 B CN108038783 B CN 108038783B
- Authority
- CN
- China
- Prior art keywords
- calculation result
- acquisition subsystem
- database
- data
- position management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Engineering & Computer Science (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Debugging And Monitoring (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a position management method, which comprises the following steps: the method comprises the steps that a currently started acquisition subsystem in an acquisition subsystem cluster sends request information to a registration center, server information and log service information of the currently started acquisition subsystem are obtained from the registration center, calculation is carried out according to a preset algorithm according to the obtained information, a first calculation result is obtained and stored in a first database for first preset time, and the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem; the currently started acquisition subsystem acquires a first calculation result from a first database, and acquires corresponding log data according to connection between the acquired first calculation result and a corresponding log service; and performing position management according to the log data. The invention also discloses a position management system and a computer readable storage medium. The invention can improve the real-time performance of position management.
Description
Technical Field
The invention relates to the technical field of finance, in particular to a position management method, a position management system and a computer-readable storage medium.
Background
Position management is an important part of the financial industry because position size and position allocation relates risks and benefits to financial companies.
At present, because the traditional bank is mainly influenced by the fluctuation of large-amount fund transactions, the industry focuses more on the large-amount transactions, and position management is mostly carried out by counting the large-amount transaction fund in and out in advance. This approach is insensitive to real-time transactions, typically requires more funds to be paid for, results in a lower rate of funds usage, and still faces the risk of position overdraft due to larger numbers of real-time transactions.
And some companies are affected not only by large-amount fund transaction fluctuation, but also by a large number of real-time transactions. Therefore, the method of position management by counting the large transaction fund entry in advance is not suitable for these companies.
Disclosure of Invention
The invention mainly aims to provide a position management method, a position management system and a computer readable medium, aiming at improving the real-time performance of position management.
In order to achieve the above object, the position management method provided by the present invention is applied to a position management system, the position management system includes an acquisition subsystem cluster and a registration center, the acquisition subsystem cluster includes at least one acquisition subsystem, the acquisition subsystem is used for sending server information to the registration center, and the position management method includes the following steps:
the method comprises the steps that a currently started acquisition subsystem in an acquisition subsystem cluster sends request information to a registration center, and server information of the currently started acquisition subsystem and log service information to be acquired are requested to be read from the registration center;
the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem;
the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service;
and managing positions according to the log data.
Optionally, the step of calculating, by the currently started acquisition subsystem according to the received server information of the currently started acquisition subsystem and the log service information according to a preset algorithm, and obtaining a first calculation result further includes:
the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem obtains a first calculation result from the first database, acquiring corresponding log data according to the connection between the obtained first calculation result and the corresponding log service, otherwise, executing the following steps: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the received log service information to obtain a first calculation result.
Optionally, the step of obtaining corresponding log data according to the connection between the obtained first calculation result and the corresponding log service includes:
when the first calculation result is stored in the first database, recording corresponding distribution time, and sending the distribution time to the registration center;
the step of obtaining the corresponding log data according to the connection between the obtained first calculation result and the corresponding log service includes:
and connecting the correspondingly connected log services according to the obtained first calculation result and a preset mutual exclusion principle to obtain corresponding log data.
Optionally, the position management method further includes:
acquiring the distribution time of each acquisition subsystem, the server information of each acquisition subsystem and the statistical information of the acquired log data from the registration center at intervals of second preset time by the currently started acquisition subsystem;
when the difference between the current time and the distribution time is greater than a third preset time, the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem does not obtain the first calculation result from the first database, the steps are executed again: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the log service information to obtain a first calculation result, and stores the first calculation result in a first database for preset time.
Optionally, the step of acquiring, by the currently started acquisition subsystem, a calculation result from the first database, and connecting the acquired calculation result with a corresponding log service, and acquiring corresponding log data further includes:
and sending corresponding server information and statistical information of the collected log data to the registration center at intervals of fourth preset time by the currently started collection subsystem.
Optionally, the step of obtaining, from the registration center, the allocation time of each acquisition subsystem, the server information of each acquisition subsystem, and the statistical information of the acquired log data at intervals of a second preset time by the currently started acquisition subsystem further includes:
if the acquisition subsystem which is not connected with the log service exists in the currently started acquisition subsystems, acquiring a first calculation result from the first database by the acquisition subsystem with the resource use of the acquisition subsystem or the log data acquisition delay exceeding a preset value, and connecting the log service correspondingly connected according to the acquired first calculation result and a preset mutual exclusion principle;
and if the first calculation result is not obtained, recalculating the acquisition subsystem with the resource use of the acquisition subsystem or the log data acquisition delay exceeding the preset value and the corresponding log service according to a preset algorithm to obtain the first calculation result, and storing the first calculation result in the first database for a first preset time.
Optionally, the step of performing position management according to the log data includes:
performing identification processing according to the identification of the log data to obtain processing result data;
storing temporary data in the processing result data to the first database, and storing final data in the processing result data to a second database;
and calculating according to the temporary data in the first database to obtain a second calculation result, and managing the position according to the second calculation result and the final data.
Optionally, the step of performing calculation according to the temporary data in the first database to obtain a second calculation result further includes:
and acquiring temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database.
Optionally, the step of performing identification processing according to the identifier of the log data to obtain processing result data includes:
filtering the log data according to a preset configuration library table and the identification result of the log data;
classifying the filtered log data to obtain processing result data;
the step of obtaining the temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database further includes:
and performing unified calculation analysis on the temporary data of the same type, and summarizing to obtain the second calculation result.
In addition, to achieve the above object, the present invention also provides a position management system, including: an acquisition subsystem, a registration center and a position management program, said position management program implementing the steps of the method as described above when executed by said acquisition subsystem and registration center.
Further, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a position management program which, when executed by a processor, implements the steps of the position management method as described above.
The position management system comprises an acquisition subsystem cluster and a registration center, wherein the acquisition subsystem cluster comprises at least one acquisition subsystem, the acquisition subsystem is used for sending server information to the registration center, sending request information to the registration center through the currently started acquisition subsystem in the acquisition subsystem cluster, and requesting to read the server information of the currently started acquisition subsystem and log service information to be acquired from the registration center; the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem; the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service; and managing positions according to the log data. Through the mode, all the started acquisition subsystems send respective server information to the registration center, then the started acquisition subsystems acquire the server information and the log service information of all the started acquisition subsystems from the registration center, calculate through a preset algorithm to obtain a first calculation result and store the first calculation result to the preset time of the first database, and each started acquisition subsystem is connected with the corresponding log service according to the first calculation result to further obtain log data in real time, so that the acquisition subsystems can acquire the position use condition of a company in time, the position use condition can be followed in real time to carry out position management, the instantaneity of the position management is improved, and the use efficiency of funds is finally improved.
Drawings
FIG. 1 is a schematic diagram of an apparatus in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a position management method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a position management method according to a second embodiment of the present invention;
fig. 4 is a schematic diagram of a detailed flow of position management according to the log data in the embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
At present, because the traditional bank is mainly influenced by the fluctuation of large-amount fund transactions, the industry focuses more on the large-amount transactions, and position management is mostly carried out by counting the large-amount transaction fund in and out in advance. This approach is insensitive to real-time transactions, typically requires more funds to be paid for, results in a lower rate of funds usage, and still faces the risk of position overdraft due to larger numbers of real-time transactions. And some companies are affected not only by large-amount fund transaction fluctuation, but also by a large number of real-time transactions. Therefore, the method of position management by counting the large transaction fund entry in advance is not suitable for these companies.
In order to solve the technical problems, the invention provides a position management method, a position management system and a computer readable storage medium, wherein the position management system comprises an acquisition subsystem cluster and a registration center, the acquisition subsystem cluster comprises at least one acquisition subsystem, the acquisition subsystem is used for sending server information to the registration center, sending request information to the registration center through the currently started acquisition subsystem in the acquisition subsystem cluster, and requesting to read the server information of the currently started acquisition subsystem and the log service information to be acquired from the registration center; the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem; the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service; and managing positions according to the log data. Through the mode, all the started acquisition subsystems send respective server information to the registration center, then the started acquisition subsystems acquire the server information of all the started acquisition subsystems and log service information to be acquired from the registration center, the server information and the log service information are calculated through a preset algorithm to obtain a first calculation result and are stored in a first database for preset time, and each started acquisition subsystem is connected with corresponding log service according to the first calculation result to further obtain log data in real time, so that the acquisition subsystems can timely acquire the position use condition of a company, position management can be carried out by following the position use condition in real time, the instantaneity of position management is improved, and finally the use efficiency of funds is improved.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The position management system comprises an acquisition subsystem and a registration center, wherein the acquisition subsystem and terminals carried in the registration can be all PCs (personal computers), and can also be terminal equipment with communication and data processing functions such as smart phones, tablet computers and portable computers.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a position management program.
In the terminal shown in fig. 1, the network interface 1004 of the acquisition subsystem is mainly used for connecting the registration center and the database of the service system, and performing data communication with the registration center and the database of the service system respectively; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the position management program stored in the memory 1005 and perform the following operations:
the method comprises the steps that a currently started acquisition subsystem in an acquisition subsystem cluster sends request information to a registration center, and server information of the currently started acquisition subsystem and log service information to be acquired are requested to be read from the registration center;
the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem;
the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service;
and managing positions according to the log data.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem obtains a first calculation result from the first database, acquiring corresponding log data according to the connection between the obtained first calculation result and the corresponding log service, otherwise, executing the following steps: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the received log service information to obtain a first calculation result.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
when the first calculation result is stored in the first database, recording corresponding distribution time, and sending the distribution time to the registration center;
and connecting the correspondingly connected log services according to the obtained first calculation result and a preset mutual exclusion principle to obtain corresponding log data.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
acquiring the distribution time of each acquisition subsystem, the server information of each acquisition subsystem and the statistical information of the acquired log data from the registration center at intervals of second preset time by the currently started acquisition subsystem;
when the difference between the current time and the distribution time is greater than a third preset time, the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem does not obtain the first calculation result from the first database, the steps are executed again: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the log service information to obtain a first calculation result, and stores the first calculation result in a first database for preset time.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
and sending corresponding server information and statistical information of the collected log data to the registration center at intervals of fourth preset time by the currently started collection subsystem.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
if the acquisition subsystem which is not connected with the log service exists in the currently started acquisition subsystems, acquiring a first calculation result from the first database, and connecting the log service which is correspondingly connected according to the acquired first calculation result and a preset mutual exclusion principle;
and if the first calculation result is not obtained, recalculating the acquisition subsystem with the resource use of the acquisition subsystem or the log data acquisition delay exceeding the preset value and the corresponding log service according to a preset algorithm to obtain the first calculation result, and storing the first calculation result in the first database for a first preset time.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
performing identification processing according to the identification of the log data to obtain processing result data;
storing temporary data in the processing result data to the first database, and storing final data in the processing result data to a second database;
and calculating according to the temporary data in the first database to obtain a second calculation result, and managing the position according to the second calculation result and the final data.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
and acquiring temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database.
Further, the processor 1001 may call the position management program stored in the memory 1005, and also perform the following operations:
filtering the log data according to a preset configuration library table and the identification result of the log data;
classifying the filtered log data to obtain processing result data;
the step of obtaining the temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database further includes:
and performing unified calculation analysis on the temporary data of the same type, and summarizing to obtain the second calculation result.
Based on the hardware structure of the account management system, the position management method provided by the invention has various embodiments.
Referring to fig. 2, fig. 2 is a flowchart illustrating a position management method according to a first embodiment of the present invention.
In this embodiment, the position management method includes:
step S10, the collection subsystem started at present in the collection subsystem cluster sends request information to the registration center, and the server information of the collection subsystem started at present and the log service information to be collected are requested to be read from the registration center;
the position management system in this embodiment may include a registration center and an acquisition subsystem cluster, where the registration center is connected to the service system, and when the service system performs a service, the service system may generate corresponding service data to be stored in the database, and then generate corresponding log data when the database stores the service data. In practical use, since the storage space of a single disk is limited, and the data generated by the business system is more and more, the number of the acquisition subsystems is at least one, and preferably a plurality of, and each acquisition subsystem may include one or more disks.
The acquisition subsystem is used for sending server information to the registration center, wherein the server information comprises information such as current CPU utilization rate, memory surplus, used memory and the like.
In the process of collecting log data, the started collection subsystem firstly sends request information to the registration center, and requests to read the server information of the collection subsystem which is started currently and the log service information which needs to be collected from the registration center.
Step S20, calculating the currently started acquisition subsystem according to the received server information of the currently started acquisition subsystem and the log service information according to a preset algorithm to obtain a first calculation result, and storing the first calculation result in a first database for a first preset time, wherein the calculation result comprises a log service list to be connected with the currently started acquisition subsystem;
and the currently started acquisition subsystem calculates a first calculation result according to the server information of the currently started acquisition subsystem read from the registration center and the log service acquisition information to be acquired by using the acquired data information according to a fixed load balancing algorithm, wherein the first calculation result comprises a log service list to be connected with each acquisition subsystem. The preset algorithm comprises the steps of setting corresponding weights according to server information of the acquisition subsystem, such as the CPU utilization rate, the memory and other states, calculating the sum of each state information after the weights are added, selecting the optimal acquisition subsystem according to the calculation result, and then carrying out corresponding pairing according to the type of the optimal acquisition subsystem and the log column needing to be connected. And storing the first calculation result to a first database for a first preset time.
Further, when the first calculation result is stored in the first database, the corresponding distribution time is recorded, and the distribution time is sent to the registration center.
Further, in order to reduce calculation, before each acquisition subsystem performs calculation, the currently started acquisition subsystem may further obtain a first calculation result from the first database; if the currently started acquisition subsystem obtains a first calculation result from the first database, acquiring corresponding log data according to the connection between the obtained first calculation result and the corresponding log service, otherwise, executing the following steps: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the received log service information to obtain a first calculation result. That is, it is checked whether the first calculation result exists in the first database, if so, step S30 is executed, otherwise, the calculation is performed.
Step S30, the collection subsystem started at present obtains the first calculation result from the first database, and obtains the corresponding log data according to the connection between the obtained first calculation result and the corresponding log service;
and the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service, thereby realizing the acquisition of real-time data from the database of the service system in real time. When the acquisition subsystem is connected to acquire log data, the embodiment does not analyze the log data, and only identifies the log identifier in the log data, namely the file header information of the log data, so as to know which database the started acquisition subsystem needs to acquire the data of which table in which database, and whether the data conforms to the service range of the currently started acquisition subsystem.
Further, step S30 may include:
and step S31, connecting the correspondingly connected log service according to the obtained first calculation result and a preset mutual exclusion principle, and obtaining corresponding log data.
The method comprises the steps that a log service list connected by acquisition subsystems according to needs is connected with corresponding log services, a mutual exclusion lock is used for ensuring that only one acquisition subsystem is connected with each log service, two different acquisition subsystems possibly try to be connected with the same log service at the same time, at the moment, according to the rule of the mutual exclusion lock, a person is connected with one log service first, and other acquisition subsystems cannot be connected with the same log service.
And step S40, managing positions according to the log data.
The recognition processing is performed based on the log data obtained in step S30, and then position management is performed based on the recognition processing result, at this time, since the log data is real-time data, the recognition processing result is also the most accurate data in the present embodiment, thereby improving the real-time performance of position management.
The invention provides a position management method, a system and a computer readable storage medium, the position management system comprises an acquisition subsystem cluster and a registration center, wherein the acquisition subsystem cluster comprises at least one acquisition subsystem, the acquisition subsystem is used for sending server information to the registration center, sending request information to the registration center through the currently started acquisition subsystem in the acquisition subsystem cluster, and requesting to read the server information of the currently started acquisition subsystem and the log service information to be acquired from the registration center; the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem; the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service; and managing positions according to the log data. Through the mode, all the started acquisition subsystems send respective server information to the registration center, then the started acquisition subsystems acquire the server information and the log service information of all the started acquisition subsystems from the registration center, calculate through a preset algorithm to obtain a first calculation result and store the first calculation result to the preset time of the first database, and each started acquisition subsystem is connected with the corresponding log service according to the first calculation result to further obtain log data in real time, so that the acquisition subsystems can timely acquire the position use condition of a company, the position use condition can be followed in real time to carry out position management, the instantaneity of position management is improved, and the use efficiency of funds is finally improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of a position management method according to a second embodiment of the present invention.
Based on the first embodiment of the position management method, the position management method may further include:
step S50, acquiring the distribution time of each acquisition subsystem, the server information of each acquisition subsystem and the statistical information of the acquired log data from the registration center at intervals of second preset time by the currently started acquisition subsystem;
further, in this embodiment, when the acquisition subsystem is connected to the log service, the acquisition subsystem acquires the registered acquisition subsystem information and log service connection information and allocation time from the registry at preset time intervals, for example, at 1 minute intervals, and the acquisition subsystem further calculates and obtains a corresponding difference according to the current time and the write-in time of the log information of the connected log service, when the acquisition subsystem which is not connected with the log service exists and the delay of the acquisition subsystem which is connected with the log service exists at present is larger than or equal to the preset average time value, selecting a collection subsystem and a connected log service which have low resource utilization (namely, the utilization rate of resources determined by CPU, memory and other information through weight calculation) and have difference values exceeding the average value, acquiring a first calculation result from a first database, and recalculating distribution connection according to a budget algorithm if the first calculation result is not acquired.
Further, when the difference between the current time and the distribution time is greater than a third preset time, the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem does not obtain the first calculation result from the first database, the steps are executed again: the method comprises the steps that server information of a collection subsystem and log services needing to be connected are started at present, calculation is carried out through a preset algorithm to obtain a first calculation result, and the first calculation result is sent to a first database.
In this embodiment, when the difference between the allocation time and the current time is greater than the preset time, for example, greater than 12 hours, the first calculation result is obtained from the first database again; if the currently started acquisition subsystem does not obtain the first calculation result from the first database, all acquisition subsystems and log services are selected for recalculation and distribution, namely the server information of the currently started acquisition subsystem and the log services to be connected are calculated through a preset algorithm to obtain the first calculation result, and the first calculation result is sent to the first database to be stored for a first preset time. And if the first calculation result is obtained, performing connection according to the obtained first calculation result.
Further, in the data acquisition process in this embodiment, the method further includes the steps of:
and sending corresponding server information and statistical information of the collected log data to the registration center at intervals of fourth preset time by the currently started collection subsystem.
In this embodiment, in order to collect log service information, in the process of collecting corresponding log data by the collection subsystem, statistics information of collecting log data within a fourth preset time is counted, where the statistics information corresponding to the collected log data includes: the method comprises the steps of collecting the number of log data, the number of effective log data and total time consumption, and further comprises log connection key, initial identification delay data and current identification delay data. After the statistics is completed, a preset time related to the statistical data is sent to the registration center, for example, the statistical data is sent to the registration center once every 30 minutes, and the registration center updates the state of the log service according to the statistical information, so that the performance condition of the corresponding log service can be known according to the statistical data, and the statistical information is reset and the statistics is performed again after the acquisition subsystem sends the statistical data. After multiple statistics, an optimal collection subsystem is selected for collecting each log service.
Further, step S50 is followed by: if the acquisition subsystem which is not connected with the log service exists in the currently started acquisition subsystems, acquiring a first calculation result from the first database by the acquisition subsystem with resource utilization or log data acquisition delay exceeding a preset value, and connecting the log service correspondingly connected according to the acquired first calculation result and a preset mutual exclusion principle;
and if the first calculation result is not obtained, recalculating the acquisition subsystem with the resource use of the acquisition subsystem or the log data acquisition delay exceeding the preset value and the corresponding log service according to a preset algorithm to obtain the first calculation result, and storing the first calculation result in the first database for a first preset time.
In the embodiment, in order to ensure real-time performance, whether an acquisition subsystem which is not connected with the log service exists is judged, if so, the acquisition subsystem with the resource use or data acquisition delay exceeding the average value obtains a first calculation result from the first database, and is connected with the log service correspondingly connected according to the obtained first calculation result and a preset mutual exclusion principle to acquire the log data; if the first calculation result is not obtained, selecting the acquisition subsystems with the resource use of the acquisition subsystems or the log data acquisition delay exceeding the preset value and the log services connected with the subsystems, calculating by adopting the load balancing algorithm again to obtain the calculation result, and storing the calculation result to the first database for the first preset time. By the method, the timeliness of collecting the log data is guaranteed.
Referring to fig. 4, fig. 4 is a schematic diagram of a detailed flow of position management according to the log data in the embodiment of the present invention.
Based on the above embodiment, step S40 further includes:
step S41, according to the identification of the log data, carrying out identification processing to obtain processing result data;
step S42, storing temporary data in the processing result data into the first database, and storing final data in the processing result data into the second database;
and step S43, calculating according to the temporary data in the first database to obtain a second calculation result, and managing the position according to the second calculation result and the final data.
In this embodiment, after the acquisition subsystem reads the log data, the identification of the acquired log data is identified to obtain processing result data, and whether the processing result data belongs to temporary data or final data is identified, and if the processing result data belongs to temporary data, the temporary data is stored in the first database, and if the processing result data belongs to final data, the temporary data is stored in the second database. And then, calculating the temporary data in the first database to obtain a second calculation result, and performing position management according to the second calculation result and the final data in the second database.
Further, step S43 may include:
and step S431, acquiring temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result to the second database.
In this embodiment, the temporary data in the first database is obtained at regular time, the obtained temporary data is summarized and calculated to obtain a second calculation result, and the second calculation result is stored in the second database.
Further, step S41 may include:
filtering the log data according to a preset configuration library table and the identification result of the log data;
and classifying the filtered log data to obtain processing result data.
The method includes the steps of reading log data from log service, reading event types and corresponding base tables according to a log writing format, filtering the data according to the base tables contained in configuration, analyzing only log data information corresponding to the configuration base tables, classifying the filtered log data to obtain processing result data, and storing the processing result data to a first database after processing.
Step S431 includes:
and performing unified calculation analysis on the temporary data of the same type, and summarizing to obtain the second calculation result.
And finally, performing unified calculation analysis according to the temporary data with the same type in the first database to obtain a second calculation result, storing the second calculation result into a second database, and performing position management according to the second calculation result and the final data.
In order to improve the execution efficiency, the event type and the corresponding base table are read according to the execution result of the log data in the log writing format, data filtering is performed according to the base table contained in configuration, only data information corresponding to the configuration base table is analyzed, the analyzed data is processed by a business processing class, the log data is filtered, classified and classified, the execution efficiency is improved, and the processed data is stored in the second database.
The invention further provides a computer readable storage medium having stored thereon a position management program, which when executed by a processor implements the steps of the position management method as described above.
The specific embodiment of the computer-readable storage medium of the present invention is substantially the same as the embodiments of the position management method described above, and will not be described herein again.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (11)
1. A position management method is applied to a position management system, the position management system comprises an acquisition subsystem cluster and a registration center, the acquisition subsystem cluster comprises at least one acquisition subsystem, the acquisition subsystem is used for sending server information to the registration center, and the position management method comprises the following steps:
the method comprises the steps that a currently started acquisition subsystem in an acquisition subsystem cluster sends request information to a registration center, and server information of the currently started acquisition subsystem and log service information to be acquired are requested to be read from the registration center;
the method comprises the steps that a currently started acquisition subsystem calculates according to a received server information of the currently started acquisition subsystem and log service information according to a preset algorithm to obtain a first calculation result, and the first calculation result is stored in a first database for a first preset time, wherein the calculation result comprises a log service list which needs to be connected with the currently started acquisition subsystem;
the currently started acquisition subsystem acquires a first calculation result from the first database, and acquires corresponding log data according to the connection between the acquired first calculation result and the corresponding log service;
position management is carried out according to the log data;
the method comprises the following steps that the currently started acquisition subsystem carries out calculation according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the received log service information, and a first calculation result is obtained, wherein the steps comprise:
the currently started acquisition subsystem calculates and obtains the weighted sum of the information of each server according to the received server information of the currently started acquisition subsystem and the weight corresponding to the information of each server;
determining an optimal acquisition subsystem according to the weighted sum of the information of each server;
and matching the optimal acquisition subsystem with the log service information to obtain a first calculation result.
2. The position management method according to claim 1, wherein the currently activated collection subsystem performs calculation according to a preset algorithm based on the received server information and the log service information of the currently activated collection subsystem, and the step of obtaining the first calculation result further comprises:
the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem obtains a first calculation result from the first database, acquiring corresponding log data according to the connection between the obtained first calculation result and the corresponding log service, otherwise, executing the following steps: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the received log service information to obtain a first calculation result.
3. The position management method according to claim 1, wherein the step of acquiring the corresponding log data based on the obtained first calculation result in connection with the corresponding log service is preceded by:
when the first calculation result is stored in the first database, recording corresponding distribution time, and sending the distribution time to the registration center;
the step of obtaining the corresponding log data according to the connection between the obtained first calculation result and the corresponding log service includes:
and connecting the correspondingly connected log services according to the obtained first calculation result and a preset mutual exclusion principle to obtain corresponding log data.
4. The position management method according to claim 3, wherein the position management method further comprises:
acquiring the distribution time of each acquisition subsystem, the server information of each acquisition subsystem and the statistical information of the acquired log data from the registration center at intervals of second preset time by the currently started acquisition subsystem;
when the difference between the current time and the distribution time is greater than a third preset time, the currently started acquisition subsystem acquires a first calculation result from the first database;
if the currently started acquisition subsystem does not obtain the first calculation result from the first database, the steps are executed again: and the currently started acquisition subsystem calculates according to a preset algorithm according to the received server information of the currently started acquisition subsystem and the log service information to obtain a first calculation result, and stores the first calculation result in a first database for preset time.
5. The position management method according to any one of claims 1 to 4, wherein the step of acquiring the corresponding log data by the currently activated acquisition subsystem by acquiring the calculation result from the first database and connecting the acquired calculation result with the corresponding log service further comprises:
and sending corresponding server information and statistical information of the collected log data to the registration center at intervals of fourth preset time by the currently started collection subsystem.
6. The position management method according to claim 5, wherein the step of obtaining the distribution time of each collection subsystem, the server information of each collection subsystem, and the statistical information of the collected log data from the registration center at intervals of a second preset time, by the currently activated collection subsystem, further comprises:
if the acquisition subsystem which is not connected with the log service exists in the currently started acquisition subsystems, acquiring a first calculation result from the first database by the acquisition subsystem with resource utilization or log data acquisition delay exceeding a preset value, and connecting the log service correspondingly connected according to the acquired first calculation result and a preset mutual exclusion principle;
and if the first calculation result is not obtained, recalculating the acquisition subsystem with the resource use of the acquisition subsystem or the log data acquisition delay exceeding the preset value and the corresponding log service according to a preset algorithm to obtain the first calculation result, and storing the first calculation result in the first database for a first preset time.
7. The position management method according to claim 1, wherein the step of performing position management based on the log data comprises:
performing identification processing according to the identification of the log data to obtain processing result data;
storing temporary data in the processing result data to the first database, and storing final data in the processing result data to a second database;
and calculating according to the temporary data in the first database to obtain a second calculation result, and managing the position according to the second calculation result and the final data.
8. The position management method according to claim 7, wherein the step of obtaining a second calculation result by performing the calculation based on the temporary data in the first database further comprises:
and acquiring temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database.
9. The position management method according to claim 8, wherein the step of performing recognition processing based on the identification of the log data to obtain processing result data comprises:
filtering the log data according to a preset configuration library table and the identification result of the log data;
classifying the filtered log data to obtain processing result data;
the step of obtaining the temporary data in the first database at regular time, performing summary calculation to obtain a second calculation result, and storing the second calculation result in the second database further includes:
and performing unified calculation analysis on the temporary data of the same type, and summarizing to obtain the second calculation result.
10. A position management system, the position management system comprising: an acquisition subsystem, a registry and a position management program which, when executed by the acquisition subsystem and the registry, carries out the steps of the method according to any one of claims 1 to 9.
11. A computer-readable storage medium, having a position management program stored thereon, which, when executed by a processor, implements the steps of the position management method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711363368.4A CN108038783B (en) | 2017-12-18 | 2017-12-18 | Position management method, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711363368.4A CN108038783B (en) | 2017-12-18 | 2017-12-18 | Position management method, system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108038783A CN108038783A (en) | 2018-05-15 |
| CN108038783B true CN108038783B (en) | 2021-07-09 |
Family
ID=62099717
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711363368.4A Active CN108038783B (en) | 2017-12-18 | 2017-12-18 | Position management method, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108038783B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111091461A (en) * | 2019-12-20 | 2020-05-01 | 辽宁振兴银行股份有限公司 | Bank position risk management system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107123046A (en) * | 2017-04-14 | 2017-09-01 | 北京金融资产交易所有限公司 | The processing system and its log processing method merchandised based on bond |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9398090B2 (en) * | 2013-01-07 | 2016-07-19 | Dropbox, Inc. | Synchronized content library |
-
2017
- 2017-12-18 CN CN201711363368.4A patent/CN108038783B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107123046A (en) * | 2017-04-14 | 2017-09-01 | 北京金融资产交易所有限公司 | The processing system and its log processing method merchandised based on bond |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108038783A (en) | 2018-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992398B (en) | Monitoring method and monitoring system of service system | |
| JP6713238B2 (en) | Electronic device, method for constructing retail store evaluation model, system and storage medium | |
| CN109495291B (en) | Calling abnormity positioning method and device and server | |
| CN111709756A (en) | Method and device for identifying suspicious communities, storage medium and computer equipment | |
| CN113095408A (en) | Risk determination method and device and server | |
| CN110610431A (en) | Intelligent claim settlement method and intelligent claim settlement system based on big data | |
| CN111666346A (en) | Information merging method, transaction query method, device, computer and storage medium | |
| US20230004979A1 (en) | Abnormal behavior detection method and apparatus, electronic device, and computer-readable storage medium | |
| CN110597719A (en) | Image clustering method, device and medium for adaptation test | |
| CN111861717A (en) | Contract account management method, device, equipment and storage medium | |
| CN110928893B (en) | Label query method, device, equipment and storage medium | |
| CN114186760A (en) | Analysis method and system for stable operation of enterprise and readable storage medium | |
| CN114595765A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN108038783B (en) | Position management method, system and computer readable storage medium | |
| US20150154606A1 (en) | System, method, and software for enterprise-wide complaint aggregation | |
| CN110782310B (en) | Method, device and system for asynchronously acquiring user attribute information from third-party platform | |
| CN109992614B (en) | Data acquisition method, device and server | |
| CN110930238A (en) | Method, device, equipment and computer readable medium for improving audit task efficiency | |
| CN115423599A (en) | Credit evaluation method and device, electronic equipment and storage medium | |
| CN115330522A (en) | Credit card approval method and device based on clustering, electronic equipment and medium | |
| CN113901046A (en) | Virtual dimension table construction method and device | |
| CN114066513A (en) | User classification method and device | |
| CN111369375A (en) | Social relationship determination method, device, equipment and storage medium | |
| CN111161042A (en) | Personal risk assessment method, device, terminal and storage medium | |
| CN110648208B (en) | Group identification method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |