CN115408461A

CN115408461A - Data information acquisition method and device, electronic equipment and medium

Info

Publication number: CN115408461A
Application number: CN202211029124.3A
Authority: CN
Inventors: 王潜
Original assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Current assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Priority date: 2022-08-25
Filing date: 2022-08-25
Publication date: 2022-11-29

Abstract

The disclosure provides a data information acquisition method, a device, equipment, a storage medium and a program product, relates to the technical field of computers, and can be applied to the technical field of finance. The method comprises the following steps: responding to a task receiving collected data information, and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at least one time information of the target log when the collection task is terminated and at least one pointer position information of the target log when the collection task is terminated, wherein the pointer position information corresponds to the time information of the target log when the collection task is terminated; determining data information of a target log; determining target pointer position information in the pointer position information when the acquisition task is terminated according to a matching result of the time information when the acquisition task is terminated and the timestamp information; and acquiring collected data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

Description

Data information acquisition method and device, electronic equipment and medium

Technical Field

The present disclosure relates to the field of computer technologies, and more particularly, to a method, an apparatus, a device, a medium, and a program product for acquiring data information.

Background

The APM log collection Agent is a log message collection tool developed based on Apache flux. Apache flash is a distributed, highly available, highly reliable system that can efficiently collect, aggregate, and move mass log data from many different sources to a centralized data store; can be used to transmit large amounts of event data.

In the process of collecting data information, when the collecting program is started again after the collecting program is closed, the memory cache is released, and the metadata of the previous collecting record does not fall to the ground. The program defaults to start collecting data information by taking the end of the current target file as a collection starting point of a new collection task. It can be seen that this results in the captured data information losing the written data of the target file from the time the program stops to the time the program starts.

Disclosure of Invention

In view of the foregoing problems, the present disclosure provides a data information obtaining method, an apparatus, a device, a medium, and a program product, which may determine, through a target configuration file, time information at the time of terminating an acquisition task that matches timestamp information of a task, for example, time information at the time of terminating an acquisition task that is closest in time to the timestamp information, and then determine pointer position information corresponding to the time information at the time of terminating an acquisition task, thereby determining target pointer position information as an acquisition start point of a current acquisition task, starting to obtain acquired data information, further implementing a function of intermittent continuous transmission, and facilitating to avoid data loss.

According to a first aspect of the present disclosure, there is provided a data information acquisition method including: responding to a task of receiving collected data information, and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at the time information of at least one collection task ending of the target log, and the pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively; determining data information of the target log; determining target pointer position information in the pointer position information when the at least one collection task is terminated according to the matching result of the time information when the at least one collection task is terminated and the timestamp information; and acquiring collected data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

According to an embodiment of the present disclosure, the configuration file of the target log includes: collecting type and path information of a target log; the determining the data information of the target log comprises: and under the condition that the acquisition type is the designated full-volume acquisition type, determining the data information of the target log according to the path information of the target log.

According to an embodiment of the present disclosure, the configuration file of the target log includes: collecting identifiers of the type and the target log; the determining the data information of the target log comprises: and under the condition that the acquisition type is the designated increment acquisition type, determining the data information of the target log according to the identifier of the target log.

According to the embodiment of the present disclosure, the data information obtaining method further includes: and placing a pointer for acquiring data information at the starting point of the data information of the target log, and acquiring the acquired data information corresponding to the target log.

According to an embodiment of the present disclosure, the determining, in response to receiving a task of collecting data information, a configuration file of a target log corresponding to the task and timestamp information corresponding to the task includes: responding to a task receiving data information, and determining whether a collection program corresponding to the task is in a closed state; starting the acquisition program under the condition that the acquisition program is determined to be in a closed state; and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task.

A second aspect of the present disclosure provides a data information acquisition apparatus including: the data processing device comprises a first determining module, a second determining module and a processing module, wherein the first determining module is used for responding to a task of receiving collected data information, and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at the time information of at least one collection task ending of the target log, and the pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively; the second determining module is used for determining the data information of the target log; a third determining module, configured to determine, according to a matching result between the time information when the at least one collection task is terminated and the timestamp information, target pointer position information in the pointer position information when the at least one collection task is terminated; and the acquisition module is used for acquiring the acquired data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the above-described data information acquisition method.

The fourth aspect of the present disclosure also provides a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to execute the above-mentioned data information acquisition method.

The fifth aspect of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the above-described data information acquisition method.

According to the data information acquisition method provided by the embodiment, the time information at the time of terminating the acquisition task, which is matched with the timestamp information of the task, can be determined through the target configuration file, for example, the time information at the time of terminating the acquisition task, which is closest to the timestamp information in terms of time, and then the pointer position information corresponding to the time information at the time of terminating the acquisition task is determined, so that the target pointer position information is determined and is used as the acquisition starting point of the current acquisition task to start acquiring the acquired data information, thereby realizing the function of intermittent continuous transmission, and being beneficial to avoiding data loss.

Drawings

The foregoing and other objects, features and advantages of the disclosure will be apparent from the following description of embodiments of the disclosure, which proceeds with reference to the accompanying drawings, in which:

fig. 1 schematically illustrates an application scenario diagram of a data information acquisition method, apparatus, device, medium, and program product according to an embodiment of the present disclosure;

FIG. 2 schematically shows a flow chart of a data information acquisition method according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates an implementation of determining acquisition data information according to an embodiment of the present disclosure;

fig. 4 schematically shows a block diagram of a data-information obtaining apparatus according to an embodiment of the present disclosure; and

fig. 5 schematically shows a block diagram of an electronic device adapted to implement the data information acquisition method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that these descriptions are illustrative only and are not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "A, B and at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include, but not be limited to, systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

The embodiment of the disclosure provides a data information acquisition method and a data information acquisition device, wherein a task for acquiring data information is received, and a configuration file of a target log corresponding to the task and timestamp information corresponding to the task are determined; the configuration file of the target log comprises: aiming at least one time information of the target log when the collection task is terminated and at least one pointer position information of the target log when the collection task is terminated, wherein the pointer position information corresponds to the time information of the target log when the collection task is terminated; determining data information of a target log; determining target pointer position information in the pointer position information when the acquisition task is terminated according to a matching result of the time information when the acquisition task is terminated and the timestamp information; and acquiring collected data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

Fig. 1 schematically shows an application scenario diagram of a data information acquisition method, apparatus, device, medium, and program product according to an embodiment of the present disclosure.

As shown in fig. 1, the application scenario 100 according to this embodiment may include

terminal devices

101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as shopping-like applications, web browser applications, search-like applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only).

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (for example only) providing support for websites browsed by users using the

terminal devices

101, 102, 103. The background management server may analyze and perform other processing on the received data such as the user request, and feed back a processing result (e.g., a webpage, information, or data obtained or generated according to the user request) to the terminal device.

It should be noted that the data information obtaining method provided by the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the data information acquisition device provided by the embodiment of the present disclosure may be generally disposed in the server 105. The data information acquisition method provided by the embodiment of the present disclosure may also be executed by a server or a server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Accordingly, the data information acquiring apparatus provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster different from the server 105 and capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

The following will describe in detail the data information acquisition method of the disclosed embodiment by means of fig. 2 based on the scenario described in fig. 1.

Fig. 2 schematically shows a flow chart of a data information acquisition method according to an embodiment of the present disclosure.

As shown in fig. 2, the embodiment includes operations S210 to S240, and the data information acquisition method may be performed by a server.

In the technical scheme of the disclosure, the data acquisition, collection, storage, use, processing, transmission, provision, disclosure, application and other processing are all in accordance with the regulations of relevant laws and regulations, necessary security measures are taken, and the public order and good custom are not violated.

In operation S210, in response to receiving a task of collecting data information, determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: the time information of at least one collection task ending aiming at the target log and the pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively.

In operation S220, data information of the target log is determined.

In operation S230, target pointer position information is determined among the at least one pointer position information at the time of terminating the acquisition task, according to a matching result of the at least one time information at the time of terminating the acquisition task and the timestamp information.

In operation S240, collected data information corresponding to the target log is acquired from the data information of the target log according to the target pointer position information.

The data information acquisition method provided by the embodiment of the invention can realize the function of collecting breakpoint continuous transmission. The historical acquisition records may be persisted, such as generating a configuration file for a target log, which is loaded after receiving the acquisition data information task to determine the starting position of the acquisition pointer when the current acquisition task is started. For example, the pointer position at the last termination of the acquisition task.

For example, a hidden directory, such as a cache directory, may be added under the configuration file directory of the acquisition program, and accordingly, the cache file is commanded in a certain manner, such as $ { source _ name } _ location. One Source can correspond to one cache file, so that mutual interference among multiple sources is avoided when multiple collection tasks are processed. The configuration file of the target log may be generated according to a plurality of preset fields in the configuration file, for example, the field name may include: path (value is absolute path of file), pointer (value is pointer position of file collection), inode (file unique identifier), apend (value is true represents incremental collection, false represents full collection), and type (value is tran represents transaction, log represents log).

Because the configuration file is a file generated by persisting the historical acquisition records, the configuration file may be used to record at least one acquisition task termination time information for the target log, and at least one acquisition task termination pointer position information respectively corresponding to the at least one acquisition task termination time information, for example, for a target log a at an acquisition task termination time of 3/15/2021, the pointer position information corresponding to the current acquisition task termination time is B1; aiming at the collection task of the log A which is terminated once in 3, 18 and 2021, the position information of the pointer corresponding to the termination of the collection task at this time is B2; the log a terminates the collection task once in 26 days 3 months 2021, and the pointer position information corresponding to the termination of the collection task this time is B3.

For example, a task that collects data information is received, and a configuration file of a target log a corresponding to the task and time stamp information 2021, 3 months, and 27 days corresponding to the task are determined. For example, the collection task with the closest time is selected, the collection task is terminated once in 26 months and 3 in 2021 according to the matching result of the time information when the collection task is terminated and the timestamp information of the log a, the pointer position information corresponding to the collection task is B3, so that the pointer position information B3 can be used as the target pointer position information, the collected data information corresponding to the target log is obtained from the data information of the target log according to the target pointer position information, and it can be seen that the data information collection of this time is started from the position where the collection is terminated last time, the data information can be prevented from being lost, and the collection omission is avoided.

Fig. 3 schematically shows an implementation of determining acquisition data information according to an embodiment of the present disclosure, see fig. 3. First, the user sends a task of collecting data information through the client 310. The server 320 responds to receiving the task of collecting data information and forwards the task to the data information acquisition device 330. The data information obtaining device 330 may, in response to receiving the task, a configuration file of a target log corresponding to the task, and timestamp information corresponding to the task, obtain data information of the target log, determine target pointer position information, and obtain collected data information corresponding to the target log from the data information of the target log according to the target pointer position information. The data information obtaining device 330 may send the obtained collected data information to the client 310.

The data information acquiring method provided in this embodiment may determine, through the target configuration file, the time information at the time of terminating the acquisition task, which is matched with the timestamp information of the task, for example, the time information at the time of terminating the acquisition task, which is closest to the timestamp information in terms of time, and then determine the pointer position information corresponding to the time information at the time of terminating the acquisition task, so as to determine the target pointer position information, which is used as the acquisition starting point of the current acquisition task, and start acquiring the acquired data information, thereby implementing a function of intermittent continuous transmission, and being beneficial to avoiding data loss.

The configuration file of the target log comprises: collecting type and path information of a target log; determining data information of a target log, including: and under the condition that the acquisition type is the designated full-volume acquisition type, determining the data information of the target log according to the path information of the target log.

The acquisition types may include full acquisition and incremental acquisition. The path information may include an absolute path. And under the condition that the acquisition type is the designated full acquisition type, taking the absolute path of the full acquisition file as a judgment condition, and taking the same absolute path as the same file, so as to determine the target log and acquire the data information of the target log.

According to the data information acquisition method provided by the embodiment, under the condition that the acquisition type is the designated full-volume acquisition type, the data information of the target log is determined according to the path information of the target log, so that the data information of the target log can be accurately determined, and the acquisition reliability is enhanced.

The configuration file of the target log comprises: collecting identifiers of types and target logs; determining data information of a target log, including: and under the condition that the acquisition type is the designated increment acquisition type, determining the data information of the target log according to the identifier of the target log.

The Inode is a unique identifier of the target log and does not change throughout the life cycle of the file. And under the condition that the acquisition type is the designated increment acquisition type, determining the target log by taking the identifier as a judgment condition, and acquiring the data information of the target log.

According to the data information acquisition method provided by the embodiment, under the condition that the acquisition type is the designated increment acquisition type, the data information of the target log is determined according to the identifier of the target log, so that the data information of the target log can be accurately determined, and the acquisition reliability is enhanced.

The data information acquisition method further comprises: and placing a pointer for acquiring the data information at the starting point of the data information of the target log, and acquiring the acquired data information corresponding to the target log.

It can be understood that by resetting the pointer, that is, placing the pointer for acquiring the data information at the starting point of the data information of the target log, it can be ensured that the complete acquired data information corresponding to the target log is acquired, which is beneficial to ensuring that no data is lost during acquisition.

For example, a reset condition may be configured, such as when the position of the pointer in the cache is greater than the file length of the file currently being read, then the reset pointer is read from the head, i.e., the beginning of the data information of the target log.

In the data information acquisition method provided by this embodiment, the pointer for acquiring data information is placed at the start point of the data information of the target log to acquire the acquired data information corresponding to the target log, so that it can be ensured that the complete acquired data information corresponding to the target log is acquired, and it is favorable for ensuring that data is not lost during acquisition.

In response to receiving a task of collecting data information, determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task, including: responding to the task of receiving the collected data information, and determining whether a collection program corresponding to the task is in a closed state; starting the acquisition program under the condition that the acquisition program is determined to be in a closed state; and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task.

It can be understood that, after receiving the task of acquiring the data information, first, it is determined whether the acquisition program is in an off state, and in the case that it is determined that the acquisition program is in the off state, starting the acquisition program indicates that the acquisition program is started for the first time after being turned off. In order to avoid losing the file write data during the period from the program stop to the start and to realize the breakpoint continuous transmission, it is necessary to determine the configuration file of the target log corresponding to the task and the timestamp information corresponding to the task.

The data information acquisition method provided by the embodiment can enhance the reliability of the acquisition program, so that the acquisition program can continue to acquire data at the pointer position of the last time after being restarted, and data loss cannot be caused.

Based on the data information acquisition method, the disclosure also provides a data information acquisition device. The apparatus will be described in detail below with reference to fig. 4.

Fig. 4 schematically shows a block diagram of the structure of a data information acquisition apparatus according to an embodiment of the present disclosure.

As shown in fig. 4, the data information acquisition apparatus 400 of this embodiment includes a first determination module 410, a second determination module 420, a third determination module 430, and an acquisition module 440.

A first determining module 410, configured to determine, in response to receiving a task of collecting data information, a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at the time information of at least one collection task ending of the target log, and the pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively; a second determining module 420, configured to determine data information of the target log; a third determining module 430, configured to determine, according to a matching result between the time information when the at least one collection task is terminated and the timestamp information, target pointer location information in the pointer location information when the at least one collection task is terminated; and an obtaining module 440, configured to obtain, according to the target pointer position information, acquired data information corresponding to the target log from the data information of the target log.

In some embodiments, the configuration file of the target log comprises: collecting type and path information of a target log; the second determining module is configured to: and under the condition that the acquisition type is the designated full-volume acquisition type, determining the data information of the target log according to the path information of the target log.

In some embodiments, the configuration file of the target log comprises: collecting identifiers of the type and the target log; the second determining module is configured to: and under the condition that the acquisition type is the designated increment acquisition type, determining the data information of the target log according to the identifier of the target log.

In some embodiments, the apparatus further comprises: and the resetting module is used for placing a pointer for acquiring data information at the starting point of the data information of the target log and acquiring the acquired data information corresponding to the target log.

In some embodiments, the first determining module is to: responding to a task receiving data information, and determining whether a collection program corresponding to the task is in a closed state; starting the acquisition program under the condition that the acquisition program is determined to be in a closed state; and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task.

According to an embodiment of the present disclosure, any plurality of the first determining module 410, the second determining module 420, the third determining module 430, and the obtaining module 440 may be combined and implemented in one module, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first determining module 410, the second determining module 420, the third determining module 430, and the obtaining module 440 may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or in any one of three implementations of software, hardware, and firmware, or in any suitable combination of any of them. Alternatively, at least one of the first determining module 410, the second determining module 420, the third determining module 430 and the obtaining module 440 may be at least partially implemented as a computer program module, which when executed, may perform a corresponding function.

As shown in fig. 5, an electronic device 500 according to an embodiment of the present disclosure includes a processor 501 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. The processor 501 may comprise, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 501 may also include onboard memory for caching purposes. Processor 501 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the disclosure.

In the RAM 503, various programs and data necessary for the operation of the electronic apparatus 500 are stored. The processor 501, the ROM502, and the RAM 503 are connected to each other by a bus 504. The processor 501 performs various operations of the method flows according to embodiments of the present disclosure by executing programs in the ROM502 and/or RAM 503. Note that the programs may also be stored in one or more memories other than the ROM502 and the RAM 503. The processor 501 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.

According to an embodiment of the present disclosure, electronic device 500 may also include an input/output (I/O) interface 505, input/output (I/O) interface 505 also being connected to bus 504. The electronic device 500 may also include one or more of the following components connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output portion 507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 508 including a hard disk and the like; and a communication section 509 including a network interface card such as a LAN card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. A drive 510 is also connected to the I/O interface 505 as needed. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted on the storage section 508 as necessary.

The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.

According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include ROM502 and/or RAM 503 and/or one or more memories other than ROM502 and RAM 503 described above.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method illustrated in the flow chart. When the computer program product runs in a computer system, the program code is used for causing the computer system to realize the data information acquisition method provided by the embodiment of the disclosure.

The computer program performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure when executed by the processor 501. The above described systems, devices, modules, units, etc. may be implemented by computer program modules according to embodiments of the present disclosure.

In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, downloaded and installed through the communication section 509, and/or installed from the removable medium 511. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511. The computer program, when executed by the processor 501, performs the above-described functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.

The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the disclosure, and these alternatives and modifications are intended to fall within the scope of the disclosure.

Claims

1. A data information acquisition method comprises the following steps:

responding to a task of receiving collected data information, and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at the time information of at least one collection task ending of the target log, and the pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively;

determining data information of the target log;

determining target pointer position information in the pointer position information when the at least one collection task is terminated according to the matching result of the time information when the at least one collection task is terminated and the timestamp information; and

and acquiring collected data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

2. The method of claim 1, wherein the configuration file of the target log comprises: collecting type and path information of a target log; the determining the data information of the target log comprises:

and under the condition that the acquisition type is the designated full-volume acquisition type, determining the data information of the target log according to the path information of the target log.

3. The method of claim 1, wherein the configuration file of the target log comprises: collecting identifiers of types and target logs; the determining the data information of the target log comprises:

and under the condition that the acquisition type is the designated increment acquisition type, determining the data information of the target log according to the identifier of the target log.

4. The method of claim 1, further comprising:

and placing a pointer for acquiring data information at the starting point of the data information of the target log, and acquiring the acquired data information corresponding to the target log.

5. The method of claim 1, wherein the determining, in response to receiving a task to collect data information, a configuration file of a target log corresponding to the task and timestamp information corresponding to the task comprises:

responding to a task of receiving collected data information, and determining whether a collection program corresponding to the task is in a closed state;

starting the acquisition program under the condition that the acquisition program is determined to be in a closed state; and

determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task.

6. A data information acquisition apparatus comprising:

the data processing device comprises a first determining module, a second determining module and a processing module, wherein the first determining module is used for responding to a task of receiving collected data information, and determining a configuration file of a target log corresponding to the task and timestamp information corresponding to the task; the configuration file of the target log comprises: aiming at the time information of at least one collection task ending of the target log, and pointer position information of at least one collection task ending corresponding to the time information of at least one collection task ending respectively;

the second determining module is used for determining the data information of the target log;

a third determining module, configured to determine, according to a matching result between the time information when the at least one collection task is terminated and the timestamp information, target pointer position information in the pointer position information when the at least one collection task is terminated; and

and the acquisition module is used for acquiring the acquired data information corresponding to the target log from the data information of the target log according to the position information of the target pointer.

7. The apparatus of claim 6, wherein the configuration file of the target log comprises: collecting type and path information of a target log; the second determining module is configured to:

8. An electronic device, comprising:

one or more processors;

a storage device for storing one or more programs,

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-5.

9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method according to any one of claims 1 to 5.

10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 5.