CN117955994A - Log collection method, device, storage medium, electronic equipment and system - Google Patents

Log collection method, device, storage medium, electronic equipment and system Download PDF

Info

Publication number
CN117955994A
CN117955994A CN202211351494.9A CN202211351494A CN117955994A CN 117955994 A CN117955994 A CN 117955994A CN 202211351494 A CN202211351494 A CN 202211351494A CN 117955994 A CN117955994 A CN 117955994A
Authority
CN
China
Prior art keywords
log
data
log data
server
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211351494.9A
Other languages
Chinese (zh)
Inventor
康腊梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BYD Co Ltd
Original Assignee
BYD Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BYD Co Ltd filed Critical BYD Co Ltd
Priority to CN202211351494.9A priority Critical patent/CN117955994A/en
Publication of CN117955994A publication Critical patent/CN117955994A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
    • H04L43/106—Active monitoring, e.g. heartbeat, ping or trace-route using time related information in packets, e.g. by adding timestamps
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Environmental & Geological Engineering (AREA)
  • Cardiology (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The disclosure relates to the technical field of computers, and in particular relates to a log gathering method, a log gathering device, a storage medium, electronic equipment and a log gathering system. The log collecting method comprises the following steps: acquiring log data, wherein the log data comprises log data of a server side and log data of a device side of a rail transit passenger service system; adding identification information for each log file in the log data, wherein the identification information comprises tag information and time stamp information; and uploading the log data added with the identification information to a log storage server according to a preset storage rule.

Description

Log collection method, device, storage medium, electronic equipment and system
Technical Field
The disclosure relates to the technical field of computers, and in particular relates to a log gathering method, a log gathering device, a storage medium, electronic equipment and a log gathering system.
Background
The rail transit passenger service system is a multimedia comprehensive information system which relies on a multimedia network technology and takes a computer system as a core, and passengers can timely and accurately know train operation information and public media information by arranging display terminals of a station hall, a platform, an entrance and a train.
The current rail transit passenger service system relates to a central server, a line server, station equipment and vehicle-mounted equipment, wherein various services are operated in the servers and the equipment, various service logs and system logs are generated in the service operation process, and log files need to be analyzed.
Disclosure of Invention
According to a first aspect of an embodiment of the present disclosure, there is provided a log aggregation method, including:
acquiring log data, wherein the log data comprises log data of a server side and log data of a device side of a rail transit passenger service system;
Adding identification information for each log file in the log data, wherein the identification information comprises tag information and time stamp information;
And uploading the log data added with the identification information to a log storage server according to a preset storage rule.
Optionally, the method further comprises:
acquiring a log query instruction, wherein the log query instruction is used for indicating a log query task of the rail transit passenger service system;
And determining target log data according to the log query instruction and the identification information of each log file in the log storage server.
Optionally, the determining target log data according to the log query instruction and the identification information of each log file in the log storage server includes:
Receiving and analyzing the log query instruction to obtain query information, wherein the query information comprises tag information and time stamp information of the target log data;
Generating a target query statement according to the query information and a preset query statement;
and carrying out log data query in the log storage server through the target query statement so as to determine the target log data.
Optionally, the acquiring log data includes:
The method comprises the steps that data acquisition is carried out on a server end at preset time interval points through a data acquisition unit arranged on the server end, so that log data of the server end are obtained; and is combined with
And reading the log data of the equipment end at the time interval point by a log reading unit arranged at the equipment end to obtain the log data of the equipment end.
Optionally, the adding identification information for each log file in the log data includes:
according to a preset data analysis rule, analyzing the log data of the server side through the data acquisition unit to obtain first log data;
according to a preset identification adding rule, adding identification information to the first log data through the data acquisition unit; and is combined with
According to the data analysis rule, analyzing the log data of the equipment end through an interface server to obtain second log data;
And adding identification information to the second log data through the interface server according to a preset identification adding rule.
Optionally, the uploading the log data with the added identification information to the log storage server according to a preset storage rule includes:
according to a preset data conversion rule, performing data conversion on the first log data added with the identification information through the data acquisition unit to obtain first log data after data conversion;
Invoking a storage interface of the log storage server through the data acquisition unit, and uploading the first log data after the data conversion to the log storage server through the storage interface; and is combined with
According to the data conversion rule, performing data conversion on the second log data added with the identification information through the interface server to obtain second log data after data conversion;
And calling a storage interface of the log storage server through the interface server, and uploading the second log data after the data conversion to the log storage server through the storage interface.
According to a second aspect of the embodiments of the present disclosure, there is provided a log gathering apparatus, including:
the system comprises an acquisition module, a storage module and a storage module, wherein the acquisition module is used for acquiring log data, and the log data comprise log data of a server side and log data of a device side of a rail transit passenger service system;
the identification adding module is used for adding identification information to each log file in the log data;
and the uploading module is used for uploading the log data added with the identification information to the log storage server according to a preset storage rule.
According to a third aspect of embodiments of the present disclosure, there is provided a computer readable medium having stored thereon a computer program which, when executed by a processing device, implements the steps of the method of any of the first aspects.
According to a fourth aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:
A storage device having at least one computer program stored thereon;
At least one processing means for executing the at least one computer program in the storage means to implement the steps of the method of any of the first aspects.
According to a fifth aspect of embodiments of the present disclosure, there is provided a rail transit passenger service system comprising: the system comprises a server side, a device side, an interface server and a log storage server;
The server side comprises a plurality of servers arranged in stations, vehicles and line centers, and a data acquisition unit for acquiring log data of the servers is arranged in each server;
The equipment end comprises a plurality of equipment arranged in the station, the vehicle and the rail transit passenger service system;
The interface server is connected with the plurality of devices to acquire log data of the plurality of devices;
The data acquisition unit and the interface server are both connected with the log storage server, and the data acquisition unit and the interface server are both used for: adding identification information for each log file in the obtained log data, wherein the identification information comprises tag information and time stamp information, and uploading the log data added with the identification information to the log storage server according to a preset storage rule.
According to the technical scheme, the log data of the server side and the log data of the equipment side of the rail transit passenger service system are obtained, the identification information including the label information and the time stamp information is added to each log file in the log data, and then the log data added with the identification information is uploaded to a unified log storage server according to a preset storage rule. Therefore, the collection and centralized storage of the log data of the server side and the equipment side of the rail transit passenger service system are realized, so that the log data of the rail transit passenger service system can be managed uniformly. Furthermore, corresponding identification information is added for each log file, so that log data query can be rapidly performed according to the identification information, the query mode of the log is simplified, and the analysis process of the log is further simplified.
Additional features and advantages of the present disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification, illustrate the disclosure and together with the description serve to explain, but do not limit the disclosure. In the drawings:
FIG. 1 is a flow chart illustrating a log pooling method according to an example embodiment.
FIG. 2 is a schematic diagram of a log pooling system according to an example embodiment.
FIG. 3 is a block diagram illustrating a log pooling device in accordance with an example embodiment.
Fig. 4 is a block diagram of an electronic device, according to an example embodiment.
Description of the reference numerals
201-Server side 202-Equipment side
203-Interface server 204-log storage server
205 Data acquisition unit
Detailed Description
Specific embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the disclosure, are not intended to limit the disclosure.
The inventor researches and discovers that the log collection mode commonly adopted in the prior art is as follows: firstly, logs generated in service running processes of stations or vehicle-mounted equipment and various servers are printed to standard output or file output through various services of the system, so that log files are stored to a specific catalog, then the log files are packaged and stored regularly or uploaded to a designated FTP server for storage through FTP or other protocols, and log files can be downloaded from the server to relevant personnel when the logs need to be inquired.
However, when the log is stored locally in a file form, the log files are often scattered in different places, and when a system is in a problem, the whole business path is generally required to be checked, the log from the equipment end to each business service at the upper layer needs to be analyzed, and at the moment, the log needs to be downloaded from a different server or the file needs to be downloaded to an FTP server, so that the log path is complicated. In addition, after different log files are obtained, each file needs to be opened to analyze the problem by searching the log at the same time point, and the process of analyzing the log is complicated.
In view of the above, the present disclosure provides a log collecting method, device, storage medium, electronic apparatus and system, so as to solve the above technical problems.
FIG. 1 is a diagram illustrating a log aggregation method according to an exemplary embodiment, including the steps of:
in step S101, log data including log data of a server side and log data of a device side of the rail transit passenger service system is acquired.
In step S102, identification information including tag information and time stamp information is added to each log file in the log data.
In step S103, according to a preset storage rule, the log data added with the identification information is uploaded to a log storage server.
It should be understood at first that the server side includes various servers involved in the rail transit passenger service system, including servers deployed in stations, servers deployed in vehicles, servers deployed in line centers, etc., and the log data of the server side includes logs generated in the running process of service applications in the various servers. The equipment end comprises equipment related to rail transit passenger services deployed at stations, vehicles and stations, the equipment is responsible for equipment end services related to the rail transit passenger services such as information playing and displaying, and log data of the equipment end comprises logs generated in the running process of the equipment end services. The log data of the server and the log data of the equipment can be respectively stored in the specified storage catalogs corresponding to the server and the equipment in a file form.
For example, a log file obtaining module may be disposed in each server and on each device to obtain log files at the server side and the device side, and identification information may be added to each obtained log file through an identification information adding module connected to the log file obtaining module, and then the log file with the added identification information may be uploaded to a designated log storage server for storage through a log file uploading module connected to the identification information adding module.
The adding of the identification information may be that data analysis is performed on each log file to obtain configuration information of each log file, then a keyword or a keyword is extracted from the configuration information to be used as tag information of the log file, and time information is extracted to be used as time stamp information of the log file. The log file with the identification information added may then be data converted to log file data in a data form receivable by the log storage server. The uploading of the log file may be by calling a log file storage interface in the log storage server through the log file uploading module, so as to upload the log file added with the identification information to the designated storage module for storage through the log file storage interface. The manner of adding the identification information and the manner of performing data conversion are not particularly limited in the embodiments of the present disclosure.
For example, the log data added with the identification information may be classified or sorted according to the identification information of each log file and a preset storage rule, and uploaded to different storage positions corresponding to the log storage module. The log storage server may use a storage module to uniformly store the received log data, for example, the log storage server may use an elastic search database service to store the log data, and the storage mode of the log storage server is not limited in the embodiment of the present disclosure.
According to the technical scheme, the log data of the server side and the log data of the equipment side of the rail transit passenger service system are obtained, the identification information including the label information and the time stamp information is added to each log file in the log data, and then the log data added with the identification information is uploaded to a unified log storage server according to a preset storage rule. Therefore, the collection and centralized storage of the log data of the server side and the equipment side of the rail transit passenger service system are realized, so that the log data of the rail transit passenger service system can be managed uniformly. Furthermore, corresponding identification information is added for each log file, so that log data query can be rapidly performed according to the identification information, the query mode of the log is simplified, and the analysis process of the log is further simplified.
In a possible manner, it is also possible to:
Acquiring a log query instruction, wherein the log query instruction is used for indicating a log query task of a rail transit passenger service system;
And determining target log data according to the log query instruction and the identification information of each log file in the log storage server.
It should be appreciated that the log storage server may perform log file presentation, and may perform a log query task of the rail transit passenger service system after receiving the log query instruction, to present the queried target log data through the log file presentation service of the log storage server. The log inquiry instruction includes file information of target log data, and the target log data can be determined according to the file information and identification information of each log file in the log storage server. The log query instruction may be issued by a staff member or automatically issued by a system, which is not limited by the embodiments of the present disclosure.
In a possible manner, determining the target log data according to the log query instruction and the identification information of each log file in the log storage server may be:
receiving and analyzing a log query instruction to obtain query information, wherein the query information comprises tag information and time stamp information of target log data;
Generating a target query statement according to the query information and a preset query statement;
And carrying out log data query in the log storage server through the target query statement to determine target log data.
It should be understood that the log query instruction includes file information of the target log data, so that the log query instruction may be parsed after receiving the log query instruction to obtain query information, where the query information includes tag information and time stamp information of the target log data. And then obtaining query information according to the preset general query statement and data analysis, generating a target query statement corresponding to the log query instruction, and then using the target query statement to perform log data query in a log storage server to obtain data meeting the target query statement, namely target log data. The query of the target log data can be realized by adopting an open source data analysis and visualization platform, for example, kibana is adopted to search and view the target log data, and the query is interacted with the log data stored in the elastic search index to jointly realize the storage, search and visualization of the log data.
In a possible manner, log data may be obtained:
The method comprises the steps that data acquisition is carried out on a server end at preset time interval points through a data acquisition unit arranged on the server end, so that log data of the server end are obtained; and is combined with
And reading the log data of the equipment end at time intervals by a log reading unit arranged at the equipment end to obtain the log data of the equipment end.
For example, for the server side, a service unit for collecting log information may be set at the server side, and the log information may be read from a log storage directory corresponding to the server side at a preset time point. The data collection unit may be set for each server at the server side to collect log data of the server, or one data collection unit may be set to collect log data of a plurality of servers at the server side, which is not particularly limited in the embodiments of the present disclosure. For example, an open source data collector Fluentd implementation may be employed, fluentd allowing for unified collection and use of log layer data. Of course, other manners of collecting the log data at the server may be adopted, which is not specifically limited in the embodiments of the present disclosure.
Aiming at the equipment end, the log information can be read from the log storage catalogue corresponding to each equipment of the equipment end at a preset time point through a service unit used for log reading in the equipment end, and the log information is uploaded to the interface server through a designated protocol. Of course, other manners of collecting log data at the device side may be adopted, which is not specifically limited in the embodiments of the present disclosure.
In a possible manner, adding identification information to each log file in the log data may be:
According to a preset data analysis rule, analyzing log data of a server end through a data acquisition unit to obtain first log data, and then adding identification information to the first log data through the data acquisition unit according to a preset identification addition rule; and is combined with
According to the data analysis rule, analyzing the log data of the equipment end through the interface server to obtain second log data, and then adding identification information to the second log data through the interface server according to a preset identification adding rule.
For example, for the server side, the data acquisition unit arranged at the server side may perform data analysis on the log data of the server side to obtain first log data, where the first log data includes configuration information of each log file at the server side, then a keyword or a keyword is extracted from the configuration information as tag information of the log file, and time information is extracted to add timestamp information to the log file.
Aiming at the equipment end, the log data of the equipment end can be subjected to data analysis through an interface server connected with a plurality of pieces of equipment to obtain second log data, wherein the second log data comprises configuration information of each log file of the equipment end, keywords or keywords are extracted from the configuration information to serve as tag information of the log files, and time information is extracted to add time stamp information to the log files. Of course, the identification information may be added to the first log data and the second log data in other manners, and the embodiment of the present disclosure does not limit the specific content of the identification adding rule.
It should be further understood that the data parsing rule may be set according to a storage form and a storage language of the log data, and the log data of the server side and the log data of the device side may also be parsed according to different data parsing rules, which are not limited in particular in the embodiments of the present disclosure.
In a possible manner, according to a preset storage rule, uploading the log data added with the identification information to a log storage server includes:
according to a preset data conversion rule, performing data conversion on the first log data added with the identification information through a data acquisition unit to obtain first log data after data conversion, and then calling a storage interface of a log storage server through the data acquisition unit to upload the first log data after data conversion to the log storage server through the storage interface; and is combined with
According to the data conversion rule, performing data conversion on the second log data added with the identification information through the interface server to obtain second log data after data conversion, and then calling a storage interface of the log storage server through the interface server to upload the second log data after data conversion to the log storage server through the storage interface.
It should be understood that, since the server side and the device side have different data protocols from the log storage server, the first log data and the second log data after the identification information is added may be subjected to data conversion, so as to implement data communication between the server side and the device side and the log storage server.
For example, for the server side, the data acquisition unit arranged at the server side may perform data format conversion on the log data of the server side, so as to obtain first log data after data conversion. Aiming at the equipment end, the data format of the log data of the equipment end can be converted through an interface server of the equipment end, which is connected with a plurality of pieces of equipment, so as to obtain second log data after data conversion. Of course, other manners may be adopted to perform data conversion on the first log data and the second log data after the identification information is added, and the specific content of the data conversion rule is not limited in the embodiments of the present disclosure.
It should be further understood that the data conversion rule may be set according to a data protocol between the server side and the device side and the log storage server, and the log data of the server side and the log data of the device side may also be converted according to different data conversion rules, which are not specifically limited in the embodiments of the present disclosure.
Based on the same inventive concept, the embodiments of the present disclosure also provide a rail transit passenger service system, and fig. 2 is a schematic diagram of a log aggregation system according to an exemplary embodiment. The system comprises: server side 201, device side 202, interface server 203, and log storage server 204;
The server side 201 comprises a plurality of servers arranged in stations, vehicles and line centers, and a data acquisition unit 205 for acquiring log data of the servers is arranged in each server;
an equipment end 202 comprising a plurality of equipment disposed within a station, vehicle, and rail transit passenger service system;
The interface server 203 is connected with a plurality of devices to acquire log data of the plurality of devices;
The data acquisition unit 205 and the interface server 203 are both connected to the log storage server 204, and the data acquisition unit 205 and the interface server 203 are both configured to: and adding identification information to each log file in the obtained log data, wherein the identification information comprises tag information and time stamp information, and uploading the log data added with the identification information to the log storage server 204 according to a preset storage rule.
With the adoption of the rail transit passenger service system, the data acquisition unit 205 and the interface server 203 can be used for respectively acquiring the log data of the server 201 and the log data of the equipment 202, respectively adding the identification information for each log file in the acquired log data, wherein the identification information comprises the tag information and the time stamp information, and uploading the log data added with the identification information to the log storage server 204 according to the preset storage rule, so that the collection and the centralized storage of the log data of the server 201 and the equipment 202 of the rail transit passenger service system are realized, and the unified management of the log data of the rail transit passenger service system is realized. Furthermore, corresponding identification information is added for each log file, so that log data query can be rapidly performed according to the identification information, the query mode of the log is simplified, and the analysis process of the log is further simplified.
Fig. 3 is a block diagram illustrating a log pooling device 300 in accordance with an example embodiment. Referring to fig. 3, the apparatus includes an acquisition module 301, and an upload module 303.
An obtaining module 301, configured to obtain log data, where the log data includes log data of a server side and log data of a device side of a rail transit passenger service system;
an identification adding module 302, configured to add identification information to each log file in the log data;
And the uploading module 303 is configured to upload the log data with the identification information added to the log storage server according to a preset storage rule.
Optionally, the log aggregation apparatus 300 further includes:
The instruction acquisition module is used for acquiring a log query instruction, wherein the log query instruction is used for indicating a log query task of the rail transit passenger service system;
And the log determining module is used for determining target log data according to the log query instruction and the identification information of each log file in the log storage server.
Optionally, the log determining module is configured to:
Receiving and analyzing the log query instruction to obtain query information, wherein the query information comprises tag information and time stamp information of the target log data;
Generating a target query statement according to the query information and a preset query statement;
and carrying out log data query in the log storage server through the target query statement so as to determine the target log data.
Optionally, the acquiring module 301 is configured to:
The method comprises the steps that data acquisition is carried out on a server end at preset time interval points through a data acquisition unit arranged on the server end, so that log data of the server end are obtained; and is combined with
And reading the log data of the equipment end at the time interval point by a log reading unit arranged at the equipment end to obtain the log data of the equipment end.
Optionally, the identifier adding module 302 is configured to:
according to a preset data analysis rule, analyzing the log data of the server side through the data acquisition unit to obtain first log data;
according to a preset identification adding rule, adding identification information to the first log data through the data acquisition unit; and is combined with
According to the data analysis rule, analyzing the log data of the equipment end through an interface server to obtain second log data;
And adding identification information to the second log data through the interface server according to a preset identification adding rule.
Optionally, the identifier adding module 302 is configured to:
according to a preset data conversion rule, performing data conversion on the first log data added with the identification information through the data acquisition unit to obtain first log data after data conversion;
Invoking a storage interface of the log storage server through the data acquisition unit, and uploading the first log data after the data conversion to the log storage server through the storage interface; and is combined with
According to the data conversion rule, performing data conversion on the second log data added with the identification information through the interface server to obtain second log data after data conversion;
And calling a storage interface of the log storage server through the interface server, and uploading the second log data after the data conversion to the log storage server through the storage interface.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
Based on the same inventive concept, the embodiments of the present disclosure also provide a computer-readable medium having stored thereon a computer program which, when executed by a processor, implements the steps of the log aggregation method provided by the present disclosure.
Fig. 4 is a block diagram of an electronic device 400, shown in accordance with an exemplary embodiment. As shown in fig. 4, the electronic device 400 may include: a processor 401, a memory 402. The electronic device 400 may also include one or more of a multimedia component 403, an input/output (I/O) interface 404, and a communication component 405.
Wherein the processor 401 is configured to control the overall operation of the electronic device 400 to perform all or part of the steps in the log assembly method described above. The memory 402 is used to store various types of data to support operation at the electronic device 400, which may include, for example, instructions for any application or method operating on the electronic device 400, as well as application-related data, such as contact data, transceived messages, pictures, audio, video, and the like. The Memory 402 may be implemented by any type or combination of volatile or non-volatile Memory devices, such as static random access Memory (Static Random Access Memory, SRAM for short), electrically erasable programmable Read-Only Memory (ELECTRICALLY ERASABLE PROGRAMMABLE READ-Only Memory, EEPROM for short), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM for short), programmable Read-Only Memory (Programmable Read-Only Memory, PROM for short), read-Only Memory (ROM for short), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia component 403 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen, the audio component being for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in the memory 402 or transmitted through the communication component 405. The audio assembly further comprises at least one speaker for outputting audio signals. The I/O interface 404 provides an interface between the processor 401 and other interface modules, which may be a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 405 is used for wired or wireless communication between the electronic device 400 and other electronic devices. Wireless Communication, such as Wi-Fi, bluetooth, near Field Communication (NFC) for short, 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or one or a combination of more of them, is not limited herein. The corresponding communication component 405 may thus comprise: wi-Fi module, bluetooth module, NFC module, etc.
In an exemplary embodiment, the electronic device 400 may be implemented by one or more Application-specific integrated circuits (ASICs), digital signal processors (DIGITAL SIGNAL processors, DSPs), digital signal processing devices (DIGITAL SIGNAL Processing Device, DSPDs), programmable logic devices (Programmable Logic Device, PLDs), field programmable gate arrays (Field Programmable GATE ARRAY, FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the log gathering method described above.
In another exemplary embodiment, a computer readable medium is also provided comprising program instructions which, when executed by a processor, implement the steps of the log pooling method described above. For example, the computer readable medium may be the memory 402 including program instructions described above, which are executable by the processor 401 of the electronic device 400 to perform the log gathering method described above.
In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-described log aggregation method when executed by the programmable apparatus.
The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to the specific details of the embodiments described above, and various simple modifications may be made to the technical solutions of the present disclosure within the scope of the technical concept of the present disclosure, and all the simple modifications belong to the protection scope of the present disclosure.
In addition, the specific features described in the foregoing embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, the present disclosure does not further describe various possible combinations.
Moreover, any combination between the various embodiments of the present disclosure is possible as long as it does not depart from the spirit of the present disclosure, which should also be construed as the disclosure of the present disclosure.

Claims (10)

1.A log gathering method, comprising:
acquiring log data, wherein the log data comprises log data of a server side and log data of a device side of a rail transit passenger service system;
Adding identification information for each log file in the log data, wherein the identification information comprises tag information and time stamp information;
And uploading the log data added with the identification information to a log storage server according to a preset storage rule.
2. The method as recited in claim 1, further comprising:
acquiring a log query instruction, wherein the log query instruction is used for indicating a log query task of the rail transit passenger service system;
And determining target log data according to the log query instruction and the identification information of each log file in the log storage server.
3. The method according to claim 2, wherein the determining target log data according to the log query instruction and the identification information of each log file in the log storage server includes:
Receiving and analyzing the log query instruction to obtain query information, wherein the query information comprises tag information and time stamp information of the target log data;
Generating a target query statement according to the query information and a preset query statement;
and carrying out log data query in the log storage server through the target query statement so as to determine the target log data.
4. The method of claim 1, wherein the obtaining log data comprises:
The method comprises the steps that data acquisition is carried out on a server end at preset time interval points through a data acquisition unit arranged on the server end, so that log data of the server end are obtained; and is combined with
And reading the log data of the equipment end at the time interval point by a log reading unit arranged at the equipment end to obtain the log data of the equipment end.
5. The method of claim 4, wherein said adding identification information for each log file in said log data comprises:
according to a preset data analysis rule, analyzing the log data of the server side through the data acquisition unit to obtain first log data;
according to a preset identification adding rule, adding identification information to the first log data through the data acquisition unit; and is combined with
According to the data analysis rule, analyzing the log data of the equipment end through an interface server to obtain second log data;
And adding identification information to the second log data through the interface server according to a preset identification adding rule.
6. The method according to claim 5, wherein uploading the log data with the identification information added to the log storage server according to a preset storage rule includes:
according to a preset data conversion rule, performing data conversion on the first log data added with the identification information through the data acquisition unit to obtain first log data after data conversion;
Invoking a storage interface of the log storage server through the data acquisition unit, and uploading the first log data after the data conversion to the log storage server through the storage interface; and is combined with
According to the data conversion rule, performing data conversion on the second log data added with the identification information through the interface server to obtain second log data after data conversion;
And calling a storage interface of the log storage server through the interface server, and uploading the second log data after the data conversion to the log storage server through the storage interface.
7. A log gathering apparatus, comprising:
the system comprises an acquisition module, a storage module and a storage module, wherein the acquisition module is used for acquiring log data, and the log data comprise log data of a server side and log data of a device side of a rail transit passenger service system;
the identification adding module is used for adding identification information to each log file in the log data;
and the uploading module is used for uploading the log data added with the identification information to the log storage server according to a preset storage rule.
8. A computer readable medium on which a computer program is stored, characterized in that the program, when being executed by a processing device, carries out the steps of the method according to any one of claims 1-6.
9. An electronic device, comprising:
A storage device having at least one computer program stored thereon;
At least one processing means for executing said at least one computer program in said storage means to carry out the steps of the method according to any one of claims 1-6.
10. A rail transit passenger service system, comprising: the system comprises a server side, a device side, an interface server and a log storage server;
The server side comprises a plurality of servers arranged in stations, vehicles and line centers, and a data acquisition unit for acquiring log data of the servers is arranged in each server;
The equipment end comprises a plurality of equipment arranged in the station, the vehicle and the rail transit passenger service system;
The interface server is connected with the plurality of devices to acquire log data of the plurality of devices;
The data acquisition unit and the interface server are both connected with the log storage server, and the data acquisition unit and the interface server are both used for: adding identification information for each log file in the obtained log data, wherein the identification information comprises tag information and time stamp information, and uploading the log data added with the identification information to the log storage server according to a preset storage rule.
CN202211351494.9A 2022-10-31 2022-10-31 Log collection method, device, storage medium, electronic equipment and system Pending CN117955994A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211351494.9A CN117955994A (en) 2022-10-31 2022-10-31 Log collection method, device, storage medium, electronic equipment and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211351494.9A CN117955994A (en) 2022-10-31 2022-10-31 Log collection method, device, storage medium, electronic equipment and system

Publications (1)

Publication Number Publication Date
CN117955994A true CN117955994A (en) 2024-04-30

Family

ID=90803731

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211351494.9A Pending CN117955994A (en) 2022-10-31 2022-10-31 Log collection method, device, storage medium, electronic equipment and system

Country Status (1)

Country Link
CN (1) CN117955994A (en)

Similar Documents

Publication Publication Date Title
CN108920659B (en) Data processing system, data processing method thereof, and computer-readable storage medium
CN109947989B (en) Method and apparatus for processing video
CN109710439B (en) Fault processing method and device
CN112836018A (en) Method and device for processing emergency plan
CN108848276A (en) Telephone number method for detecting availability, system, equipment and storage medium
CN113157659A (en) Log processing method and device
CN113556480B (en) Vehicle continuous motion video generation method, device, equipment and medium
CN110895587B (en) Method and device for determining target user
CN111488386B (en) Data query method and device
CN112162905A (en) Log processing method and device, electronic equipment and storage medium
CN113763008A (en) Application promotion tracking method, device, server, equipment and medium
CN109144864B (en) Method and device for testing window
CN117955994A (en) Log collection method, device, storage medium, electronic equipment and system
CN116450624A (en) Method and device for acquiring blood margin data among heterogeneous data
CN111045915A (en) Safety test method and device based on product function test case
CN106649678B (en) Data processing method and system
CN110955709B (en) Data processing method and device and electronic equipment
CN111399843B (en) Method, system and electronic equipment for mapping SQL running information to SQL file
CN113590985A (en) Page jump configuration method and device, electronic equipment and computer readable medium
CN113704203A (en) Log file processing method and device
CN103577406B (en) A kind of method and device managing unstructured data
CN111597198A (en) Internet of things data query method for heterogeneous resource access and related equipment
CN111259121A (en) Log processing method, device, equipment and computer readable storage medium
CN112752165A (en) Subtitle processing method, subtitle processing device, server and computer-readable storage medium
US7433865B2 (en) Information collection retrieval system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination