CN115905151A - Method, system and device for querying circulation information based on backup log - Google Patents
Method, system and device for querying circulation information based on backup log Download PDFInfo
- Publication number
- CN115905151A CN115905151A CN202211410398.7A CN202211410398A CN115905151A CN 115905151 A CN115905151 A CN 115905151A CN 202211410398 A CN202211410398 A CN 202211410398A CN 115905151 A CN115905151 A CN 115905151A
- Authority
- CN
- China
- Prior art keywords
- log
- service
- backed
- backup
- logs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a method, a system and a device for querying circulation information based on a backup log, wherein the method comprises the following steps: acquiring logs to be backed up of each service system; carrying out classified backup on the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backed log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and query efficiency is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method, a system and a device for querying circulation information based on backup logs.
Background
In the process of service handling, transaction messages are subjected to step-by-step flow conversion processing through a plurality of partition nodes of a plurality of service systems, relevant service logs are generated through the nodes, if a user needs to inquire a certain service, the user needs to log in each service system in sequence, flow each node partition, manually input a corresponding command to enter an appointed directory, and input an appointed command to retrieve the service under the appointed directory.
Disclosure of Invention
One object of the present invention is to provide a method for querying information of flow based on backup logs, which can query the information of service flow from the backup logs quickly, save time and manpower resources, and improve query efficiency. The invention also aims to provide a circulation information inquiry device based on the backup log. It is yet another object of the present invention to provide a computer readable medium. It is a further object of the present invention to provide a computer apparatus.
In order to achieve the above object, the present invention discloses a method for querying circulation information based on a backup log, including:
acquiring logs to be backed up of each service system;
classifying and backing up the logs to be backed up to obtain a log information list;
receiving a service query request sent by a user;
and inquiring corresponding service flow information from the pre-backed log information list according to the service inquiry request.
Preferably, the obtaining the log to be backed up of each service system includes:
reading service logs of each service system in a preset server list in a multithreading mode according to a preset time period;
acquiring service logs of each service system;
comparing the read service log with the obtained service log to obtain an incremental log of each service system;
and determining the incremental logs of each service system as the logs to be backed up of each service system.
Preferably, the classifying and backing up the log to be backed up to obtain the log information list includes:
acquiring a log backup path corresponding to a log to be backed up through a preset server list;
downloading the log to be backed up to a backup area indicated by a log backup path through a specified network transmission protocol, and completing log backup of the log to be backed up;
and generating a log information list according to the log information of the backed-up log.
Preferably, the service inquiry request includes a retrieval condition;
inquiring corresponding service flow information from a pre-backed log information list according to the service inquiry request, wherein the service flow information comprises the following steps:
and according to the retrieval conditions, performing matching query from the log information list to obtain service flow information.
Preferably, the service flow information includes flow service data and a flow passing service system;
after querying out the corresponding service flow information from the pre-backed up log information list according to the service query request, the method further comprises the following steps:
generating a circulation track graph according to circulation service data and a circulation passing service system;
and visually displaying the circulation trajectory diagram.
Preferably, after the log to be backed up is classified and backed up to obtain the log information list, the method further includes:
and according to a preset log cleaning strategy, asynchronously cleaning the backed-up service logs in each service system.
The invention also discloses a system for inquiring the circulation information based on the backup log, which comprises the following steps:
the system comprises a service system, a backup server and a log database;
the business system is used for generating a log to be backed up;
the backup server is used for carrying out classified backup on the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; inquiring corresponding service flow information from a pre-backed log information list according to the service inquiry request;
the log database is used for storing a log information list.
Preferably, the system further comprises: a server database;
the server database is used for storing a server list;
the backup server is used for reading the service logs of each service system in a preset server list in a multithreading mode according to a preset time period; acquiring service logs of each service system; comparing the read service log with the obtained service log to obtain an incremental log of each service system; and determining the incremental logs of each service system as the logs to be backed up of each service system.
The invention also discloses a device for inquiring the circulation information based on the backup log, which comprises the following components:
the acquisition unit is used for acquiring logs to be backed up of each service system;
the classified backup unit is used for performing classified backup on the logs to be backed up to obtain a log information list;
a receiving unit, configured to receive a service query request sent by a user;
and the query unit is used for querying the corresponding service flow information from the pre-backed log information list according to the service query request.
Preferably, the obtaining unit is specifically configured to read, according to a preset time period, a service log of each service system in a preset server list in a multi-thread manner; acquiring service logs of each service system; comparing the read service log with the obtained service log to obtain an incremental log of each service system; and determining the incremental logs of each service system as the logs to be backed up of each service system.
Preferably, the classified backup unit is specifically configured to obtain, through a preset server list, a log backup path corresponding to a log to be backed up; downloading the log to be backed up to a backup area indicated by a log backup path through a specified network transmission protocol, and completing log backup of the log to be backed up; and generating a log information list according to the log information of the backed-up log.
Preferably, the service inquiry request includes a retrieval condition;
and the query unit is specifically used for performing matching query from the log information list according to the retrieval conditions to obtain the service flow information.
Preferably, the service flow information includes flow service data and a flow passing service system;
the device still includes:
the generating unit is used for generating a circulation track diagram according to the circulation service data and the circulation passing service system;
and the display unit is used for visually displaying the circulation trajectory diagram.
Preferably, the apparatus further comprises:
and the cleaning unit is used for asynchronously cleaning the backed-up service logs in each service system according to a preset log cleaning strategy.
The invention also discloses a computer-readable medium, on which a computer program is stored which, when executed by a processor, implements a method as described above.
The invention also discloses a computer device comprising a memory for storing information comprising program instructions and a processor for controlling the execution of the program instructions, the processor implementing the method as described above when executing the program.
The invention also discloses a computer program product comprising a computer program/instructions which, when executed by a processor, implement the method as described above.
The method comprises the steps of obtaining logs to be backed up of each service system; classifying and backing up the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backed log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and query efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a system for querying circulation information based on a backup log according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for querying circulation information based on a backup log according to an embodiment of the present invention;
fig. 3 is a flowchart of another method for querying circulation information based on a backup log according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a flow information query device based on a backup log according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the method, the system and the device for querying the circulation information based on the backup log disclosed by the application can be applied to the technical field of artificial intelligence and can also be applied to any field except the technical field of artificial intelligence.
In order to facilitate understanding of the technical solutions provided in the present application, the following first describes relevant contents of the technical solutions in the present application. The invention carries out log backup based on the application logs of each node associated with the computer service system by using a Secure File Transfer Protocol (SFTP), quickly inquires service flow information based on the backup logs in a multithreading mode, is beneficial to quickly positioning, analyzing and solving service problems, improves the quality and efficiency of service, is beneficial to reducing the operation and maintenance cost of the test environment of the service system and increases the reliability of the external service environment.
Fig. 1 is a schematic structural diagram of a system for querying streaming information based on backup logs according to an embodiment of the present invention, and as shown in fig. 1, the system includes: a business system 100, a backup server 200, and a log database 300. The service system 100 is connected to the backup server 200, and the backup server 200 is connected to the log database 300.
The number of the service systems 100 is plural, and different service systems 100 may be responsible for different service processes, for example: business system 100 is a payment system. Fig. 1 shows only one business system 100. The service system 100 is configured to generate a log to be backed up, where the log to be backed up is generated during a circulation process of service processing.
The backup server 200 is configured to perform classified backup on the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; and inquiring corresponding service flow information from the pre-backed log information list according to the service inquiry request.
The log database (altp.db.db) 300 is a lightweight database SQLite which occupies low resources and supports various operating systems. The log database 300 is used to store a log information list.
In the embodiment of the present invention, the system further includes: the server database 400, the server database 400 is connected to the backup server 200 and the business system 100, respectively.
The server database (serverms. Db) 400 is a lightweight database SQLite which occupies low resources and supports various operating systems. The server database 400 is used to store a server inventory.
The backup server 200 is configured to read the service logs of each service system 100 in a preset server list in a multi-thread manner according to a preset time period; acquiring a service log of each service system 100; comparing the read service log with the obtained service log to obtain an incremental log of each service system 100; and determining the incremental log of each service system 100 as the log to be backed up of each service system 100.
It should be noted that the circulation information query system based on the backup log shown in fig. 1 is further configured to execute the circulation information query method based on the backup log shown in fig. 2 or fig. 3, which is not described in detail herein.
In the embodiment of the invention, logs to be backed up of each service system are obtained; classifying and backing up the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backed log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and query efficiency is improved.
The following describes an implementation process of the backup log-based circulation information query method according to an embodiment of the present invention, taking a circulation information query device based on a backup log as an execution subject. It can be understood that the execution subject of the circulation information query method based on the backup log provided by the embodiment of the present invention includes, but is not limited to, a circulation information query device based on the backup log.
Fig. 2 is a flowchart of a method for querying circulation information based on a backup log according to an embodiment of the present invention, and as shown in fig. 2, the method includes:
And 102, performing classified backup on the logs to be backed up to obtain a log information list.
And step 103, receiving a service inquiry request sent by a user.
And 104, inquiring corresponding service flow information from the pre-backed log information list according to the service inquiry request.
It should be noted that the technical solutions in the present application, such as obtaining, storing, using, and processing data, all conform to relevant regulations of national laws and regulations. The user information in the embodiment of the application is obtained through legal compliance, and the user information is obtained, stored, used, processed and the like through authorization approval of a client.
In the technical scheme provided by the embodiment of the invention, logs to be backed up of each service system are obtained; classifying and backing up the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backup log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and the query efficiency is improved.
Fig. 3 is a flowchart of another method for querying streaming information based on backup logs according to an embodiment of the present invention, and as shown in fig. 3, the method includes:
In the embodiment of the invention, each step is executed by a circulation information inquiry device based on the backup log.
In the embodiment of the present invention, the time period is set according to an actual requirement, which is not limited in the embodiment of the present invention.
In the embodiment of the invention, the server list is preset, and the server list comprises but is not limited to the name, the address, the log backup path and the business system to which the log belongs. Because of the laboratory environment, the number of servers of similar nodes is large, the log types of the backup servers are distinguished through parameterization configuration, the names, the addresses, the log backup paths, the business systems to which the logs belong and other information of the servers are parameterized, and a server list is generated; the server manifest is stored to a server database (servermsg.
Specifically, according to a timing task of a preset time period, a server list in the servermsg.db is read in a multi-thread timing mode, and service logs generated by each service system are read. Taking reading a certain type of system logs as an example, the type of system logs is divided into N service systems, each service system corresponds to one or more remote servers, the logs in each remote server are divided into a plurality of data folders according to different nodes, and each data folder stores corresponding service logs of various types. Each service system reads the service log through M threads together, that is, there are nxm threads to read the service log at the same time. N and M are integers greater than or equal to 1, the capacity of the thread pool is P, and the thread pool can be adjusted according to the resources of the log collection server to ensure that the log collection server is stable and effective.
It should be noted that the multi-thread processing mode is also used for log processing operations such as subsequent downloading, backup and cleaning of the log.
In the embodiment of the invention, the server of the service system is a remote server, and the service log of the remote server is obtained.
And step 203, comparing the read service log with the obtained service log to obtain the incremental log of each service system.
In the embodiment of the invention, the service log read through the server list is compared with the service log generated in the remote server to obtain the incremental log corresponding to each service system, and the non-incremental log is the backed-up log. And an incremental backup mode is adopted, so that the read-write operation of the disk is reduced, the backup efficiency is improved, and the storage space is saved.
And step 204, determining the incremental logs of each service system as logs to be backed up of each service system.
In the embodiment of the invention, the log to be backed up is the log which needs to be downloaded and transferred to the designated backup area, and a data basis is provided for the follow-up service inquiry.
And step 205, performing classified backup on the logs to be backed up to obtain a log information list.
In the embodiment of the invention, different logs have different log types, and the logs to be backed up are classified and backed up according to the different log types to obtain the log information list. The log information list includes, but is not limited to, a message identification number, an originating row number, a system to which the message belongs, and a message transaction time.
In the embodiment of the present invention, step 205 specifically includes:
step 2051, obtaining a log backup path corresponding to the log to be backed up through a preset server list.
In the embodiment of the invention, the logs to be backed up are matched through the server list to obtain the corresponding log backup path.
And step 2052, downloading the log to be backed up to the backup area indicated by the log backup path through a specified network transmission protocol, and completing the log backup of the log to be backed up.
In the embodiment of the invention, the specified network transport protocol is a Secure File Transfer Protocol (SFTP), and the SFTP is a network transport protocol for data stream connection and providing access, transmission and management functions.
Specifically, the logs to be backed up are classified and downloaded through the SFTP, and are stored in a backup area indicated by the log backup path, so that log backup of the logs to be backed up is completed.
And step 2053, generating a log information list according to the log information of the backed-up log.
In the embodiment of the invention, log analysis is carried out on the backed-up log to obtain structured log information, wherein the log information comprises but is not limited to a message identification number, an initiating line number, a system to which the message belongs and message transaction time; and generating a log information list according to the log information so as to be used for subsequent users to inquire the service.
Further, after the logs of each server are backed up, the backed-up logs of the servers are asynchronously cleaned, server space is released, and the availability of the storage resources of the servers is not lower than the specified availability, wherein the specified availability is 70% as an alternative. Specifically, according to a preset log cleaning strategy, the backed-up service logs in each service system are asynchronously cleaned.
In the embodiment of the invention, a multithreading processing mode is adopted, each thread can read the log of a remote server in a service system, and synchronous downloading and asynchronous cleaning are carried out. As an alternative, the log cleaning policy may be made according to the date or the number of generated logs. For example: and F log directories or files are set to be saved, and only F log directories or files on the latest generation date are saved after log backup is completed, and other logs on the remote server are cleaned, so that the problem of resource shortage of the remote server of the service system is greatly relieved, and the problem of system downtime caused by the fact that the service log is written into a disk space is solved.
In the embodiment of the invention, the service query request comprises retrieval conditions, and the retrieval conditions comprise but are not limited to one or any combination of a message identification number, an initiating row number, a message affiliated system and message transaction time.
And step 207, performing matching query from the log information list according to the retrieval conditions to obtain service flow information.
In the embodiment of the invention, a network (web) frame is used for receiving the retrieval condition sent by the front end, retrieving the backup log in a log information list, inquiring the processing condition and the circulation path of the service, and obtaining the service circulation information, wherein the service circulation information comprises the circulation service data and the circulation service system. As an alternative, the network framework is a Bottle framework, which is a fast, small and lightweight Web Server Gateway Interface (WSGI) micro Web framework.
And 208, generating a circulation track graph according to the circulation service data and the circulation passing service system.
In the embodiment of the invention, the circulation trace diagram comprises all the service systems through which the service flows from the beginning to the end and service data obtained after the service processing in all the service systems. In the embodiment of the invention, a user can acquire the service processing conditions of all the associated node servers through one operation of inputting the retrieval conditions, the service circulation condition is positioned in time, the query efficiency is high, the retrieval speed is high, the pressure of manual customer service on external support is relieved, and the system operation and maintenance and the external service efficiency are greatly improved.
And 209, visually displaying the circulation trajectory diagram.
In the embodiment of the invention, the processing condition of the service is displayed to the user in the form of the circulation track diagram, so that the user can clearly and intuitively check the circulation condition and the data processing result of the service, and the user experience is improved.
In the technical scheme of the flow information query method based on the backup logs, logs to be backed up of each business system are obtained; classifying and backing up the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backed log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and query efficiency is improved.
Fig. 4 is a schematic structural diagram of a flow information query device based on a backup log according to an embodiment of the present invention, where the device is configured to execute the flow information query method based on the backup log, and as shown in fig. 4, the device includes: an acquisition unit 11, a classification backup unit 12, a receiving unit 13 and a query unit 14.
The obtaining unit 11 is configured to obtain logs to be backed up of each service system.
The classified backup unit 12 is configured to perform classified backup on the logs to be backed up to obtain a log information list.
The receiving unit 13 is configured to receive a service query request sent by a user.
The query unit 14 is configured to query the corresponding service flow information from the pre-backed log information list according to the service query request.
In the embodiment of the present invention, the obtaining unit 11 is specifically configured to read, according to a preset time period, service logs of each service system in a preset server list in a multithreading manner; acquiring service logs of each service system; comparing the read service log with the obtained service log to obtain an incremental log of each service system; and determining the incremental logs of each service system as the logs to be backed up of each service system.
In the embodiment of the present invention, the classified backup unit 12 is specifically configured to obtain, through a preset server list, a log backup path corresponding to a log to be backed up; downloading the log to be backed up to a backup area indicated by a log backup path through a specified network transmission protocol, and completing log backup of the log to be backed up; and generating a log information list according to the log information of the backed-up log.
In the embodiment of the invention, the service query request comprises a retrieval condition; the query unit 14 is specifically configured to perform matching query from the log information list according to the retrieval condition, so as to obtain the service flow information.
In the embodiment of the invention, the service flow information comprises the flow service data and the service system through which the flow passes; the device still includes: a generating unit 15 and a presentation unit 16.
The generating unit 15 is configured to generate a flow trace graph according to the flow service data and the service system through which the flow passes.
The display unit 16 is used for visually displaying the circulation trajectory diagram.
In the embodiment of the present invention, the apparatus further includes: a cleaning unit 17.
The cleaning unit 17 is configured to perform asynchronous cleaning on the backed-up service logs in each service system according to a preset log cleaning policy.
In the scheme of the embodiment of the invention, logs to be backed up of each service system are obtained; carrying out classified backup on the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; according to the service query request, the corresponding service flow information is queried from the pre-backed log information list, the service flow information can be rapidly queried from the backup log, time and human resources are saved, and query efficiency is improved.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer device, which may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
The embodiment of the present invention provides a computer device, which includes a memory and a processor, where the memory is used to store information including program instructions, and the processor is used to control execution of the program instructions, and the program instructions are loaded and executed by the processor to implement the steps of the above-mentioned embodiment of the method for querying circulation information based on backup logs, and for specific description, reference may be made to the above-mentioned embodiment of the method for querying circulation information based on backup logs.
Referring now to FIG. 5, shown is a schematic diagram of a computer device 600 suitable for use in implementing embodiments of the present application.
As shown in fig. 5, the computer apparatus 600 includes a Central Processing Unit (CPU) 601 which can execute various appropriate jobs and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data necessary for the operation of the computer apparatus 600 are also stored. The CPU601, ROM602, and RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output section 607 including a Cathode Ray Tube (CRT), a liquid crystal feedback (LCD), and the like, and a speaker and the like; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted as necessary on the storage section 608.
In particular, the processes described above with reference to the flowcharts may be implemented as a computer software program according to an embodiment of the present invention. For example, embodiments of the invention include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the various elements may be implemented in the same one or more pieces of software and/or hardware in the practice of the present application.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of other like elements in a process, method, article, or apparatus comprising the element.
According to the technical scheme, the data acquisition, storage, use, processing and the like meet relevant regulations of national laws and regulations.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the system embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for relevant points.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (17)
1. A circulation information query method based on backup logs is characterized by comprising the following steps:
acquiring logs to be backed up of each service system;
classifying and backing up the logs to be backed up to obtain a log information list;
receiving a service query request sent by a user;
and inquiring corresponding service flow information from a pre-backed log information list according to the service inquiry request.
2. The method for querying circulation information based on the backup log according to claim 1, wherein the obtaining the log to be backed up of each service system comprises:
reading service logs of each service system in a preset server list in a multithreading mode according to a preset time period;
acquiring service logs of each service system;
comparing the read service log with the obtained service log to obtain an incremental log of each service system;
and determining the incremental logs of each service system as the logs to be backed up of each service system.
3. The method for querying circulation information based on the backup log as claimed in claim 1, wherein the classifying and backing up the log to be backed up to obtain the log information list comprises:
acquiring a log backup path corresponding to the log to be backed up through a preset server list;
downloading the log to be backed up to a backup area indicated by the log backup path through a specified network transmission protocol to complete log backup of the log to be backed up;
and generating a log information list according to the log information of the backed-up log.
4. The method of claim 1, wherein the service query request includes a search condition;
the querying, according to the service query request, of the corresponding service flow information from the pre-backed up log information list includes:
and according to the retrieval conditions, performing matching query from the log information list to obtain the service flow information.
5. The method of claim 1, wherein the service flow information includes flow service data and a flow passing service system;
after querying the corresponding service flow information from the pre-backed log information list according to the service query request, the method further includes:
generating a circulation track graph according to the circulation service data and the circulation passing service system;
and visually displaying the circulation trajectory diagram.
6. The method for querying circulation information based on backup logs according to claim 1, wherein after the classifying and backing up the logs to be backed up to obtain the log information list, the method further comprises:
and according to a preset log cleaning strategy, asynchronously cleaning the backed-up service logs in each service system.
7. A system for querying information of a stream based on a backup log, the system comprising: the system comprises a service system, a backup server and a log database;
the business system is used for generating a log to be backed up;
the backup server is used for carrying out classified backup on the logs to be backed up to obtain a log information list; receiving a service query request sent by a user; inquiring corresponding service flow information from a pre-backed log information list according to the service inquiry request;
the log database is used for storing a log information list.
8. The system of claim 7, wherein the system further comprises: a server database;
the server database is used for storing a server list;
the backup server is used for reading the service logs of each service system in a preset server list in a multithreading mode according to a preset time period; acquiring service logs of each service system; comparing the read service log with the obtained service log to obtain an incremental log of each service system; and determining the incremental logs of each service system as the logs to be backed up of each service system.
9. A circulation information inquiry device based on a backup log is characterized in that the device comprises:
the acquisition unit is used for acquiring logs to be backed up of each service system;
the classified backup unit is used for performing classified backup on the logs to be backed up to obtain a log information list;
a receiving unit, configured to receive a service query request sent by a user;
and the query unit is used for querying the corresponding service flow information from the pre-backed log information list according to the service query request.
10. The streaming information retrieving apparatus according to claim 9, wherein the backup log-based streaming information retrieving means further comprises,
the acquisition unit is specifically configured to read service logs of each service system in a preset server list in a multi-thread manner according to a preset time period; acquiring service logs of each service system; comparing the read service log with the obtained service log to obtain an incremental log of each service system; and determining the incremental logs of each service system as the logs to be backed up of each service system.
11. The apparatus for querying circulation information based on backup log according to claim 9,
the classified backup unit is specifically configured to obtain, through a preset server list, a log backup path corresponding to the log to be backed up; downloading the log to be backed up to a backup area indicated by the log backup path through a specified network transmission protocol to complete the log backup of the log to be backed up; and generating a log information list according to the log information of the backed-up log.
12. The apparatus of claim 9, wherein the service query request includes a search condition;
the query unit is specifically configured to perform matching query from the log information list according to the retrieval condition, so as to obtain the service flow information.
13. The apparatus of claim 9, wherein the service flow information includes service data and service systems through which the flow passes;
the device further comprises:
the generating unit is used for generating a circulation track diagram according to the circulation service data and the circulation passing service system;
and the display unit is used for visually displaying the circulation track diagram.
14. The apparatus of claim 9, wherein the apparatus further comprises:
and the cleaning unit is used for asynchronously cleaning the backed-up service logs in each service system according to a preset log cleaning strategy.
15. A computer-readable medium on which a computer program is stored, the program, when executed by a processor, implementing the method for querying circulation information based on a backup log according to any one of claims 1 to 6.
16. A computer device comprising a memory for storing information including program instructions and a processor for controlling the execution of the program instructions, wherein the program instructions when loaded and executed by the processor implement the method of streaming information based on backup logs of any one of claims 1 to 6.
17. A computer program product comprising computer programs/instructions, wherein the computer programs/instructions, when executed by a processor, implement the method for querying information of circulation based on backup logs according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211410398.7A CN115905151A (en) | 2022-11-11 | 2022-11-11 | Method, system and device for querying circulation information based on backup log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211410398.7A CN115905151A (en) | 2022-11-11 | 2022-11-11 | Method, system and device for querying circulation information based on backup log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115905151A true CN115905151A (en) | 2023-04-04 |
Family
ID=86481787
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211410398.7A Pending CN115905151A (en) | 2022-11-11 | 2022-11-11 | Method, system and device for querying circulation information based on backup log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115905151A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117093406A (en) * | 2023-10-18 | 2023-11-21 | 浙江印象软件有限公司 | Log center maintenance method and system |
-
2022
- 2022-11-11 CN CN202211410398.7A patent/CN115905151A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117093406A (en) * | 2023-10-18 | 2023-11-21 | 浙江印象软件有限公司 | Log center maintenance method and system |
| CN117093406B (en) * | 2023-10-18 | 2024-02-09 | 浙江印象软件有限公司 | Log center maintenance method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111339073A (en) | Real-time data processing method and device, electronic equipment and readable storage medium | |
| US20110029822A1 (en) | Tracking of java objects during request processing | |
| CN110389989B (en) | Data processing method, device and equipment | |
| CN111784329A (en) | Service data processing method and device, storage medium and electronic device | |
| CN111209310A (en) | Service data processing method and device based on stream computing and computer equipment | |
| CN110557291A (en) | Network service monitoring system | |
| CN113468226A (en) | Service processing method, device, electronic equipment and storage medium | |
| CN113391973A (en) | Internet of things cloud container log collection method and device | |
| CN114820080A (en) | User grouping method, system, device and medium based on crowd circulation | |
| CN115905151A (en) | Method, system and device for querying circulation information based on backup log | |
| CN106777265B (en) | Service data processing method and device | |
| CN114077518A (en) | Data snapshot method, device, equipment and storage medium | |
| CN112559525B (en) | Data checking system, method, device and server | |
| CN110909072B (en) | Data table establishment method, device and equipment | |
| CN112491943A (en) | Data request method, device, storage medium and electronic equipment | |
| CN112445861A (en) | Information processing method, device, system and storage medium | |
| CN110019045B (en) | Log floor method and device | |
| CN111078905A (en) | Data processing method, device, medium and equipment | |
| CN112148705A (en) | Data migration method and device | |
| CN108023920B (en) | Data packet transmission method, equipment and application interface | |
| CN115794783A (en) | Data deduplication method, device, equipment and medium | |
| CN112667393B (en) | Method and device for building distributed task computing scheduling framework and computer equipment | |
| CN115620877A (en) | Method, system, equipment and storage medium for uploading medical data to cloud platform | |
| CN106557530A (en) | Operation system, data recovery method and device | |
| CN111459931A (en) | Data duplication checking method and data duplication checking device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |