CN108920355B - Dotting event information acquisition method and device, computer equipment and storage medium - Google Patents

Dotting event information acquisition method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN108920355B
CN108920355B CN201810546986.0A CN201810546986A CN108920355B CN 108920355 B CN108920355 B CN 108920355B CN 201810546986 A CN201810546986 A CN 201810546986A CN 108920355 B CN108920355 B CN 108920355B
Authority
CN
China
Prior art keywords
information
dotting
event information
client
matched
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810546986.0A
Other languages
Chinese (zh)
Other versions
CN108920355A (en
Inventor
杨小成
王小亮
黄奉线
姜志
石峰
程超
吉训宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kangjian Information Technology Shenzhen Co Ltd
Original Assignee
Kangjian Information Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kangjian Information Technology Shenzhen Co Ltd filed Critical Kangjian Information Technology Shenzhen Co Ltd
Priority to CN201810546986.0A priority Critical patent/CN108920355B/en
Publication of CN108920355A publication Critical patent/CN108920355A/en
Application granted granted Critical
Publication of CN108920355B publication Critical patent/CN108920355B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/362Software debugging
    • G06F11/3636Software debugging by tracing the execution of the program
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/362Software debugging
    • G06F11/366Software debugging using diagnostics

Abstract

The application relates to a dotting event information acquisition method, a dotting event information acquisition device, computer equipment and a storage medium. The method comprises the following steps: receiving a control information set and an interface calling information set sent by a client; generating an automatic dotting configuration file according to the received control information set and the interface calling information set; feeding back the automatic dotting configuration file to the client; receiving dotting event information monitored by the client through the automatic dotting configuration file; selecting matched dotting event information from the received dotting event information through preset configuration information; the matched dotting event information is stored in a data repository. By adopting the method, invalid codes can be prevented from being written, so that the code writing quantity for developing and collecting dotting event information is greatly reduced, and the development efficiency is improved.

Description

Dotting event information acquisition method and device, computer equipment and storage medium
Technical Field
The present disclosure relates to the field of data acquisition technologies, and in particular, to a method, an apparatus, a computer device, and a storage medium for acquiring dotting event information.
Background
With the development of internet technology, more and more data are carried by the network, and more services are handled on the network. In order to analyze the behavior of a person on the internet, behavior information of the user on the network is generally collected, and the dotting event information is one of the behavior information of the user.
In a conventional manner of collecting the information of the dotting event, codes for collecting the information are manually buried during development of an application program or writing of a webpage, so that the information of the dotting event is collected when a user uses the application program or the webpage.
However, the inventor has found that the current dotting event information collection method can disable the code for collecting information if the code for collecting information is not updated synchronously when the code of an application program or a web page is updated. Under the condition that the codes of the application programs or the web pages are updated frequently, if the codes of the acquired information are updated simultaneously, the writing quantity of the codes is obviously increased greatly, so that the development time of the application programs or the web pages is prolonged, and the development efficiency is low.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a dotting event information collection method, apparatus, computer device, and storage medium that can improve development efficiency.
A method for collecting dotting event information, the method comprising:
receiving a control information set and an interface calling information set sent by a client;
generating an automatic dotting configuration file according to the received control information set and the interface calling information set;
feeding back the automatic dotting configuration file to the client;
receiving dotting event information monitored by the client through the automatic dotting configuration file;
selecting matched dotting event information from the received dotting event information through preset configuration information;
the matched dotting event information is stored in a data repository.
In one embodiment, the method further comprises:
selecting matched control information and interface call information from the control information set and the interface call information set;
defining the matched control information and interface call information as dotting event information;
adding an event tag to the dotting event information;
and arranging the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
In one embodiment, the method further comprises:
receiving element information sent by the client, wherein the element information is captured by the client through a monitoring event, and the monitoring event is registered by the client according to the automatic dotting configuration file;
And analyzing the element information to obtain dotting event information.
In one embodiment, the method further comprises:
acquiring latest generated preset configuration information from a preset configuration information base;
sequentially selecting dotting event information according to the arrangement sequence of the dotting event information;
judging whether the selected dotting event information is matched with the preset configuration information;
if yes, confirming and selecting matched dotting event information.
In one embodiment, the method further comprises:
judging whether the path of the dotting event information is the same as the path in the preset configuration information; if not the same, then
Continuously judging whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not equal to each other, then
Calculating redundancy of any combination of paths, texts and links of the dotting event information;
and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
In one embodiment, the method further comprises:
when the selected dotting event information is not matched with the preset configuration information, then
Writing unmatched dotting event information into a cache database;
Inquiring dotting event information meeting time error conditions with the time information from the cache database according to the time information of the preset configuration information;
judging whether the queried dotting event information is matched with the preset configuration information;
if yes, confirming and selecting matched dotting event information.
In one embodiment, the method further comprises:
when the matched dotting event information is selected, encrypting the matched dotting event information;
writing the encrypted dotting event information into a system log in real time;
in this embodiment, the method further includes:
and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
A dotting event information collection device, the device comprising:
the information receiving module is used for receiving the control information set and the interface calling information set sent by the client;
the configuration file generation module is used for generating an automatic dotting configuration file according to the received control information set and the interface call information set;
the configuration file feedback module is used for feeding back the automatic dotting configuration file to the client;
The information receiving module is also used for receiving dotting event information monitored by the client through the automatic dotting configuration file;
the information selection module is used for selecting matched dotting event information from the received dotting event information through preset configuration information;
and the information storage module is used for storing the matched dotting event information into the data warehouse.
A computer device comprising a memory storing a computer program and a processor which when executing the computer program performs the steps of:
receiving a control information set and an interface calling information set sent by a client;
generating an automatic dotting configuration file according to the received control information set and the interface calling information set;
feeding back the automatic dotting configuration file to the client;
receiving dotting event information monitored by the client through the automatic dotting configuration file;
selecting matched dotting event information from the received dotting event information through preset configuration information;
the matched dotting event information is stored in a data repository.
A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
Receiving a control information set and an interface calling information set sent by a client;
generating an automatic dotting configuration file according to the received control information set and the interface calling information set;
feeding back the automatic dotting configuration file to the client;
receiving dotting event information monitored by the client through the automatic dotting configuration file;
selecting matched dotting event information from the received dotting event information through preset configuration information;
the matched dotting event information is stored in a data repository.
According to the dotting event information acquisition method, the dotting event information acquisition device, the computer equipment and the storage medium, after the control information set and the interface call information set sent by the client are received, an automatic dotting configuration file can be generated according to the control information set and the interface call information set, the automatic dotting configuration file is fed back to the client, the client can monitor dotting event information on the client according to the automatic dotting configuration file, codes for acquiring information do not need to be pre-buried on the client, codes of the client and codes of the automatic dotting configuration file can be separated, and the number of codes written when the client is developed is reduced. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
Drawings
FIG. 1 is an application scenario diagram of a dotting event information collection method in one embodiment;
FIG. 2 is a flowchart of a method for collecting dotting event information in one embodiment;
FIG. 3 is an application scenario diagram of a dotting event information collection method in another embodiment;
FIG. 4 is a flowchart of a method for collecting dotting event information in another embodiment;
FIG. 5 is a block diagram of a dotting event information collection device in one embodiment;
fig. 6 is an internal structural diagram of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The dotting event information acquisition method provided by the application can be applied to an application environment shown in fig. 1. Wherein the client 110 communicates with the server 120 via a network. The server 120 receives a control information set and an interface call information set sent by a client on the client 110; generating an automatic dotting configuration file according to the received control information set and the interface calling information set; the automated dotting profile is fed back to the client 110. The server 120 receives the dotting event information monitored by the client 110 through the automatic dotting configuration file; selecting matched dotting event information from the received dotting event information through preset configuration information; the matched dotting event information is stored in a data repository.
The client 110 may be, but not limited to, various personal computers, notebook computers, smartphones, tablet computers, and portable wearable devices, and the server 120 may be implemented by a stand-alone server or a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a method for collecting information of a dotting event is provided, and the method is applied to the server 120 in fig. 1 for illustration, and includes the following steps:
s202, receiving a control information set and an interface calling information set sent by a client.
Wherein the client is an application providing local services to the user. The client may be a mobile terminal application or a PC (personal computer ) terminal application, or may be a browser for displaying a web server or a file system. The control information set is a set of control information of the client. The control information is information for controlling the client. The control information may specifically be an action (service agent) running on the control client. The interface call information set is a set of interface call information of the client. The interface call information is information for calling an interface of the client. The interface call information may specifically call an API (Application Programming Interface ) on the client.
In one embodiment, a server receives a control information set and an interface call information set, classifies the control information set and the interface call information set according to user information identifiers in the control information set and the interface call information set, and ranks the control information in the control information set and the interface call information in the interface call information set according to time information in the control information set and the interface call information set.
In one embodiment, the client collects control information of actions on the client through a request object, and after identifying an API called by the client, collects interface calling information corresponding to the called API. The client packages the control information and the interface call information acquired through the request object into a control information set and an interface call information set, adds the user identity and then sends the control information and the interface call information to the server.
S204, generating an automatic dotting configuration file according to the received control information set and the interface call information set.
The automatic dotting configuration file can be specifically used for indicating the client to automatically collect dotting event information according to configuration parameters in the automatic dotting configuration information.
The automatic dotting configuration file is generated according to the received control information set and the interface call information set, and specifically, the server generates the automatic dotting configuration file according to the control information in the control information set and the interface call information in the interface call information set.
In one embodiment, the server generates an automatic dotting configuration file according to control information in the control information set and interface call information in the interface call information set, writes the automatic dotting configuration file into a dotting configuration file library, and generates corresponding configuration file path information.
S206, feeding back the automatic dotting configuration file to the client.
In one embodiment, the server sends profile path information to the client. After the client analyzes the configuration file path information, the client feeds back confirmation information for confirming the automatic dotting configuration file corresponding to the received configuration file path information to the server. And after receiving the confirmation information fed back by the client, the server sends an automatic dotting configuration file to the client.
S208, the dotting event information monitored by the client through the automatic dotting configuration file is received.
The dotting event information may specifically be a combination of control information and interface call information, or may be separate control information or interface call information. The information of the dotting event monitored by the client through the automatic dotting configuration file can be specifically that the client registers a monitoring event through the automatic dotting configuration file, and monitors the information of the dotting event through the monitoring event.
In one embodiment, after the client monitors the dotting event information, if the client detects that the client cannot communicate with the server in real time, the monitored dotting event information is written into the data buffer area, and after a connection channel for real-time communication is established with the server, the dotting event information written into the data buffer area is sent to the server through the connection channel.
S210, selecting matched dotting event information from the received dotting event information through preset configuration information.
The preset configuration information is configuration information for screening dotting event information. The preset configuration information may specifically include at least one of user identification, time information, path information, link information, text information, and the like. The matching dotting event information is selected, and specifically, the server selects the dotting event information with matched parameters according to the parameters in the preset configuration information and the parameters in the dotting event information.
In one embodiment, the server writes the dotting event information received from the client into the system log and the cache database, and after acquiring the preset configuration information, selects the dotting event information from the system log and the cache database, and selects the matched dotting event information through the preset configuration information.
S212, storing the matched dotting event information into a data warehouse.
The data repository may in particular be an HDFS (Hadoop Distributed File System, distributed file system). The data repository may be specifically configured to store at least one of an automated dotting profile, a set of control information, a set of interface call information, dotting event information, preset configuration information, and the like.
In one embodiment, the server splits the matched dotting event information into data fragments and stores the data fragments in a data warehouse.
According to the dotting event information acquisition method, after the control information set and the interface call information set sent by the client are received, the automatic dotting configuration file can be generated according to the control information set and the interface call information set, the automatic dotting configuration file is fed back to the client, the client can monitor the dotting event information on the client according to the automatic dotting configuration file, codes for acquiring information do not need to be pre-buried on the client, the codes of the client and the codes of the automatic dotting configuration file can be separated, and the code quantity written when the client is developed is reduced. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
In one embodiment, the method further comprises: selecting matched control information and interface call information from the control information set and the interface call information set; defining the matched control information and interface call information as dotting event information; adding an event tag to the dotting event information; and arranging the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
Wherein the event tag is an identification describing the dotting event information. The event label can be defined manually or automatically generated according to a preset naming rule. For example, an event label of the dotting event information may be manually defined as "long press confirm button", or may be automatically generated as "dotting event 56" according to a preset naming rule.
Specifically, the control information and the interface call information which are matched are selected from the control information set and the interface call information set, and the control information and the interface call information which are matched in capturing time can be selected by the server. For example, the control information in the control information set and the interface call information in the interface call information set are arranged according to the capturing time of the millisecond level, and because the client collects the artificial operation information, a plurality of operations are difficult to be performed simultaneously within one millisecond, the matched control information and interface call information can be intuitively selected through the millisecond-level time arrangement control information and interface call information. The capture time is the time when the client captures control information or interface call information.
In this embodiment, by adding an event tag to the dotting event information, different dotting event information can be distinguished more quickly and accurately, and according to the event tag, the dotting event information is arranged to generate an automatic dotting configuration file, redundant dotting event information in the automatic dotting configuration file can be reduced, so that the code quantity of the automatic dotting configuration file is reduced, and the efficiency of a client for collecting the dotting event information by using the automatic dotting configuration file is higher.
In one embodiment, the method further comprises: receiving element information sent by the client, wherein the element information is captured by the client through a monitoring event, and the monitoring event is registered by the client according to the automatic dotting configuration file; and analyzing the element information to obtain dotting event information.
The element information is information acquired by the client, and can form control information and interface calling information. The element information includes at least one of text, href, xpath, url, uid, time, and the like. The listening event is used on the client to listen for triggered events. The snoop event may specifically include at least one of a click snoop event, a load snoop event, and a slide snoop event.
In one embodiment, the client sends a request to download the page file to the server when a web page link is triggered. And after receiving the request for downloading the page file, the server feeds back the page file and the path information of the configuration file to the client. The client loads the web page according to the page file and obtains an automated dotting configuration file from a cdn (Content Delivery Network ) server according to the link address in the configuration file path information. The client registers a click monitoring event, a load monitoring event and a slide monitoring event according to the automatic dotting configuration file, and captures triggered element information when the webpage is triggered by a user. The client compresses the captured element information into a compressed file and sends the compressed file to the server.
In one embodiment, when the client detects that the w3c standard is not supported (World Wide Web Consortium), the client pre-loads the page file after receiving the page file sent by the server and obtaining the automated dotting configuration file from the cdn server, and delays loading the automated dotting configuration file after a preset period of time.
In this embodiment, element information is analyzed to obtain dotting event information by receiving element information sent by a client, the element information is captured by a monitoring event registered by the client through an automatic dotting configuration file, and when a code for collecting the dotting event information is not built in the client, the dotting event information can be collected through the automatic dotting configuration file, so that code redundancy of the client can be reduced, and development efficiency of the client is accelerated.
In one embodiment, the method further comprises: acquiring latest generated preset configuration information from a preset configuration information base; sequentially selecting dotting event information according to the arrangement sequence of the dotting event information; judging whether the selected dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
The preset configuration information base is a database for generating and storing preset configuration information.
In one embodiment, after confirming that the matched dotting event information is selected, the server feeds back the successfully matched dotting event information and corresponding preset configuration information to the preset configuration information base. The preset configuration information base updates preset configuration information according to the received dotting event information and the corresponding preset configuration information.
In this embodiment, whether the dotting event information is matched with the preset configuration information is determined by acquiring the latest generated preset configuration information, so that the checked and selected dotting event information can be ensured to conform to the rule of the budget configuration information, and the validity of the acquired dotting event information is ensured.
In one embodiment, the method further comprises: judging whether the path of the dotting event information is the same as the path in the preset configuration information; if not, continuing to judge whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not, calculating redundancy of any combination of paths, texts and links of the dotting event information; and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
Where redundancy is the difference between the maximum amount of information a certain number of signal units may have and the actual amount of information they contain. Any combination of the path, the text and the link may be a combination of the path, the text and the link, or a combination of the path and the text, the path and the link, the text and the link, the path and the text and the link, and the like, which are not listed here. The redundancy is specifically obtained by calculating the similarity between any combination of paths, texts and links of the dotting event information and the corresponding combination in the preset configuration information. The redundancy of paths, text and links may in particular be calculated separately.
In one embodiment, when the server determines that the path of the dotting event information is the same as the path in the preset configuration information, the server determines that the dotting event information is matched with the preset configuration information.
In one embodiment, when the server determines that the text and/or the link of the dotting event information is equal to the text and/or the link in the preset configuration information, the server determines that the dotting event information is matched with the preset configuration information.
In one embodiment, the server calculates redundancy of any combination of the path, text and link of the dotting event information, when the redundancy is greater than or equal to 0.9, it determines that the dotting event information is matched with the preset configuration information, and when the redundancy is less than 0.9, it determines that the dotting event information is not matched with the preset configuration information, and ends the matching process.
In this embodiment, whether the dotting event information matches with the preset configuration information may be determined by determining whether the path, text, and link of the dotting event information are the same as the path, text, and link in the preset configuration information, and by determining whether the redundancy of the path, text, and link is greater than a preset value. By comparing the dimensions, a matching result can be obtained more accurately.
In one embodiment, the method further comprises: when the selected dotting event information is not matched with the preset configuration information, writing the unmatched dotting event information into a cache database; inquiring dotting event information meeting time error conditions with the time information from the cache database according to the time information of the preset configuration information; judging whether the queried dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
The time error condition may be that a difference between time information of the dotting event information and time information of the preset configuration information is within a preset range.
In this embodiment, unmatched dotting event information is written into the cache database, and can be matched again after the preset configuration information is updated, so that the fact that the dotting event information is screened when the current condition of the preset configuration information is not met is avoided, and the utilization rate of the dotting event information is increased.
In one embodiment, the method further comprises: when the matched dotting event information is selected, encrypting the matched dotting event information; writing the encrypted dotting event information into a system log in real time; in this embodiment, the method further includes: and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
The matching dotting event information is encrypted, which may specifically be hash encryption of the matching dotting event. The encrypted dotting event information in the system log is stored in the data warehouse in batches, specifically, redundant data of the encrypted dotting event information in the system log is separated and packed into a redundant data set, unrepeated data in the dotting event information is separated into data fragments, and then the redundant data set and the data fragments are stored in the data warehouse.
In one embodiment, when the server selects the matched dotting event information, hash encryption is performed on the dotting event information according to the user information identifier corresponding to the dotting event information, and the encrypted dotting event information is immediately written into the system log. When the server detects that the number of the encrypted dotting event information in the system log exceeds a preset value, the encrypted dotting event information in the system log is divided into a redundant data set and a data fragment, and then the redundant data set and the data fragment are stored in a data warehouse.
In this embodiment, the security of the dotting event information may be enhanced by encrypting the dotting event information before writing the dotting event information into the system log, and when the number of the dotting event information encrypted in the system log exceeds a preset value at a preset time point or when the number of the dotting event information is detected to exceed a preset value, the dotting event information is stored in the data warehouse in batches, so that the dotting event information may be managed in a centralized manner, the scattering of the dotting event information may be avoided, and the pressure of the data warehouse may be increased, thereby improving the efficiency of managing the data warehouse.
As shown in fig. 3, an application environment of the dotting event information collection method in one embodiment is shown, in which the client 310 communicates with the docking server 320 through a network, and the docking server 320, the log system 330, the cache database 340, the real-time computing module 350, the preset configuration information library 360 and the data repository 370 library communicate through a network or a cable.
As shown in fig. 4, in one embodiment, there is further provided a method for collecting information of a dotting event, which is applied to a plurality of computer devices in fig. 3 for illustration, and includes the following steps:
s402, the docking server 320 receives the control information set and the interface call information set sent by the client 310.
S404, the docking server 320 stores the control information set and the interface call information set in the log system 330 and the cache database 340.
S406, the real-time computing module 350 obtains the control information set and the interface call information set from the log system 330 and the cache database 340.
S408, the real-time computing module 350 selects the matched control information and interface call information from the control information set and the interface call information set.
S410, the real-time computing module 350 defines the matched control information and interface call information as dotting event information.
S412, the real-time computing module 350 adds an event tag to the dotting event information.
S414, the real-time computing module 350 arranges the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
S416, the docking server 320 feeds back the automatic dotting configuration file to the client 310.
S418, the client 310 registers the listening event according to the automatic dotting profile.
S420, the client 310 captures element information by listening for events.
S422, the docking server 320 receives the element information sent by the client 310.
S424, the docking server 320 analyzes the element information to obtain dotting event information.
S426, the docking server 320 stores the dotting event information to the log system 330 and the cache database 340.
S428, the real-time computing module 350 obtains the latest generated preset configuration information from the preset configuration information base 360.
S430, the real-time computing module 350 selects the dotting event information from the log system 330.
S432, the real-time computing module 350 determines whether the path of the dotting event information is the same as the path in the preset configuration information.
If not, executing step S434; if yes, judging that the dotting event information is matched with the preset configuration information.
In S434, the real-time computing module 350 determines whether the text and/or the link of the dotting event information is equal to the text and/or the link in the preset configuration information.
If not, executing step S436; if yes, judging that the dotting event information is matched with the preset configuration information.
S436, the real-time calculation module 350 calculates redundancy of any combination of path, text, and link of the dotting event information.
When the calculated redundancy is greater than the preset value, the real-time calculation module 350 performs step S440; when the calculated redundancy is smaller than the preset value, the real-time computing module 350 executes step S438.
At S438, the real-time computing module 350 writes the unmatched dotting event information into the cache database 340.
S440, the real-time computing module 350 determines that the dotting event information matches the preset configuration information.
The logging system 330 stores 442 the matched dotting event information into the data warehouse 370.
According to the dotting event information acquisition method, after the control information set and the interface call information set sent by the client are received, the automatic dotting configuration file can be generated according to the control information set and the interface call information set, the automatic dotting configuration file is fed back to the client, the client can monitor the dotting event information on the client according to the automatic dotting configuration file, codes for acquiring information do not need to be pre-buried on the client, the codes of the client and the codes of the automatic dotting configuration file can be separated, and the code quantity written when the client is developed is reduced. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
It should be understood that, although the steps in the flowcharts of fig. 2-4 are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in fig. 2-4 may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily occur sequentially, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or steps.
In one embodiment, as shown in fig. 5, there is provided a dotting event information collection apparatus 500, including: an information receiving module 502, a configuration file generating module 504, a configuration file feedback module 506, an information selecting module 508 and an information storing module 510, wherein:
the information receiving module 502 is configured to receive a control information set and an interface call information set sent by a client; a configuration file generating module 504, configured to generate an automatic dotting configuration file according to the received control information set and the interface call information set; a profile feedback module 506, configured to feed back the automatic dotting profile to the client; the information receiving module 502 is further configured to receive dotting event information monitored by the client through the automated dotting configuration file; the information selection module 508 is configured to select matching dotting event information from the received dotting event information through preset configuration information; and the information storage module 510 is used for storing the matched dotting event information into the data warehouse.
The above-mentioned dotting event information collection device 500, after receiving the control information set and the interface call information set sent by the client, can generate an automatic dotting configuration file according to the control information set and the interface call information set, and then feed back the automatic dotting configuration file to the client, and the client can monitor the dotting event information on the client according to the automatic dotting configuration file, without embedding the code for collecting information on the client, can separate the code of the client from the code of the automatic dotting configuration file, and reduces the code quantity written when developing the client. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
In one embodiment, the information selecting module 508 is further configured to select matched control information and interface call information from the control information set and the interface call information set; the apparatus further comprises: the information definition module is used for defining the matched control information and interface calling information as dotting event information; the tag adding module is used for adding event tags to the dotting event information; the configuration file generating module 504 is further configured to, for the control information set and the dotting event information existing in the interface call information set, arrange the dotting event information according to the corresponding event tags, and generate an automatic dotting configuration file.
In one embodiment, the information receiving module 502 is further configured to receive element information sent by the client, where the element information is captured by the client through a listening event, and the listening event is registered by the client according to the automatic dotting configuration file; the apparatus further comprises: and the information analysis module is used for analyzing the element information to obtain dotting event information.
In one embodiment, the apparatus further comprises: the configuration information selection module is used for acquiring latest preset configuration information from the preset configuration information base; the information selecting module is also used for sequentially selecting the dotting event information according to the arrangement sequence of the dotting event information; the information matching module is used for judging whether the selected dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the information matching module is further configured to determine whether the path of the dotting event information is the same as the path in the preset configuration information; if not, continuing to judge whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not, calculating redundancy of any combination of paths, texts and links of the dotting event information; and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
In one embodiment, the information storage module 510 is further configured to, when the selected dotting event information does not match the preset configuration information, write the unmatched dotting event information into the cache database; the apparatus further comprises: the information inquiry module is used for inquiring dotting event information meeting a time error condition with the time information from the cache database according to the time information of the preset configuration information; the information matching module is also used for judging whether the queried dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the apparatus further comprises: the information encryption module is used for encrypting the matched dotting event information when the matched dotting event information is selected; the information storage module 510 is further configured to write the encrypted dotting event information into the system log in real time; and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
For specific limitation of the dotting event information collection device, reference may be made to the limitation of the dotting event information collection method hereinabove, and the description thereof will not be repeated here. The modules in the dotting event information acquisition device can be all or partially realized by software, hardware and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 6. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used for storing dotting event information acquisition data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements a dotting event information collection method.
It will be appreciated by those skilled in the art that the structure shown in fig. 6 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided comprising a memory storing a computer program and a processor that when executing the computer program performs the steps of: receiving a control information set and an interface calling information set sent by a client; generating an automatic dotting configuration file according to the received control information set and the interface calling information set; feeding back the automatic dotting configuration file to the client; receiving dotting event information monitored by the client through the automatic dotting configuration file; selecting matched dotting event information from the received dotting event information through preset configuration information; the matched dotting event information is stored in a data repository.
According to the computer equipment, after the control information set and the interface call information set sent by the client are received, the automatic dotting configuration file can be generated according to the control information set and the interface call information set, the automatic dotting configuration file is fed back to the client, the client can monitor dotting event information on the client according to the automatic dotting configuration file, codes for collecting information are not needed to be pre-buried on the client, the codes of the client and the codes of the automatic dotting configuration file can be separated, and the code quantity written when the client is developed is reduced. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
In one embodiment, the processor when executing the computer program further performs the steps of: selecting matched control information and interface call information from the control information set and the interface call information set; defining the matched control information and interface call information as dotting event information; adding an event tag to the dotting event information; and arranging the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
In one embodiment, the processor when executing the computer program further performs the steps of: receiving element information sent by the client, wherein the element information is captured by the client through a monitoring event, and the monitoring event is registered by the client according to the automatic dotting configuration file; and analyzing the element information to obtain dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring latest generated preset configuration information from a preset configuration information base; sequentially selecting dotting event information according to the arrangement sequence of the dotting event information; judging whether the selected dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: judging whether the path of the dotting event information is the same as the path in the preset configuration information; if not, continuing to judge whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not, calculating redundancy of any combination of paths, texts and links of the dotting event information; and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
In one embodiment, the processor when executing the computer program further performs the steps of: when the selected dotting event information is not matched with the preset configuration information, writing the unmatched dotting event information into a cache database; inquiring dotting event information meeting time error conditions with the time information from the cache database according to the time information of the preset configuration information; judging whether the queried dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: when the matched dotting event information is selected, encrypting the matched dotting event information; writing the encrypted dotting event information into a system log in real time; in this embodiment, the processor when executing the computer program further implements the following steps: and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of: receiving a control information set and an interface calling information set sent by a client; generating an automatic dotting configuration file according to the received control information set and the interface calling information set; feeding back the automatic dotting configuration file to the client; receiving dotting event information monitored by the client through the automatic dotting configuration file; selecting matched dotting event information from the received dotting event information through preset configuration information; the matched dotting event information is stored in a data repository.
According to the computer readable storage medium, after the control information set and the interface call information set sent by the client are received, the automatic dotting configuration file can be generated according to the control information set and the interface call information set, the automatic dotting configuration file is fed back to the client, the client can monitor dotting event information on the client according to the automatic dotting configuration file, codes for collecting information are not needed to be embedded on the client, the codes of the client and the codes of the automatic dotting configuration file can be separated, and the code quantity written when the client is developed is reduced. And the automatic dotting configuration file is generated by calling the information set through the control information set and the interface, and the information of which dotting events needs to be acquired can be obtained, so that the automatic dotting configuration information is generated according to the requirements, invalid codes are further prevented from being written, the code writing quantity for developing and acquiring the dotting event information is greatly reduced, and the development efficiency is improved.
In one embodiment, the processor when executing the computer program further performs the steps of: selecting matched control information and interface call information from the control information set and the interface call information set; defining the matched control information and interface call information as dotting event information; adding an event tag to the dotting event information; and arranging the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
In one embodiment, the processor when executing the computer program further performs the steps of: receiving element information sent by the client, wherein the element information is captured by the client through a monitoring event, and the monitoring event is registered by the client according to the automatic dotting configuration file; and analyzing the element information to obtain dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring latest generated preset configuration information from a preset configuration information base; sequentially selecting dotting event information according to the arrangement sequence of the dotting event information; judging whether the selected dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: judging whether the path of the dotting event information is the same as the path in the preset configuration information; if not, continuing to judge whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not, calculating redundancy of any combination of paths, texts and links of the dotting event information; and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
In one embodiment, the processor when executing the computer program further performs the steps of: when the selected dotting event information is not matched with the preset configuration information, writing the unmatched dotting event information into a cache database; inquiring dotting event information meeting time error conditions with the time information from the cache database according to the time information of the preset configuration information; judging whether the queried dotting event information is matched with the preset configuration information; if yes, confirming and selecting matched dotting event information.
In one embodiment, the processor when executing the computer program further performs the steps of: when the matched dotting event information is selected, encrypting the matched dotting event information; writing the encrypted dotting event information into a system log in real time; in this embodiment, the processor when executing the computer program further implements the following steps: and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims (10)

1. A method for collecting dotting event information, the method comprising:
receiving a control information set and an interface calling information set sent by a client, wherein control information in the control information set is used for controlling a service agent running on the client, and interface calling information in the interface calling information set is information for calling an interface of the client;
Generating an automatic dotting configuration file according to the received control information set and the interface calling information set;
feeding back the automatic dotting configuration file to the client;
receiving dotting event information monitored by the client through the automatic dotting configuration file;
selecting matched dotting event information from the received dotting event information through preset configuration information;
storing the matched dotting event information in a data warehouse;
wherein the generating an automatic dotting configuration file according to the received control information set and the interface call information set comprises:
selecting control information and interface call information which are matched in capturing time from the control information set and the interface call information set, wherein the control information in the control information set and the interface call information in the interface call information set are arranged according to capturing time of millisecond level, and the capturing time is the time when the client captures the control information or the interface call information;
defining the matched control information and interface call information as dotting event information;
adding an event tag to the dotting event information;
And arranging the dotting event information existing in the control information set and the interface calling information set according to the corresponding event labels to generate an automatic dotting configuration file.
2. The method of claim 1, wherein the receiving the dotting event information that the client monitors through the automated dotting profile comprises:
receiving element information sent by the client, wherein the element information is captured by the client through a monitoring event, and the monitoring event is registered by the client according to the automatic dotting configuration file;
and analyzing the element information to obtain dotting event information.
3. The method according to claim 1, wherein selecting matching dotting event information from the received dotting event information by preset configuration information comprises:
acquiring latest generated preset configuration information from a preset configuration information base;
sequentially selecting dotting event information according to the arrangement sequence of the dotting event information;
judging whether the selected dotting event information is matched with the preset configuration information;
if yes, confirming and selecting matched dotting event information.
4. A method according to claim 3, wherein said determining whether the selected dotting event information matches the preset configuration information comprises:
judging whether the path of the dotting event information is the same as the path in the preset configuration information; if not the same, then
Continuously judging whether the text and/or the link of the dotting event information are equal to the text and/or the link in the preset configuration information; if not equal to each other, then
Calculating redundancy of any combination of paths, texts and links of the dotting event information;
and when the calculated redundancy is larger than a preset value, judging that the dotting event information is matched with the preset configuration information.
5. A method according to claim 3, characterized in that the method further comprises:
when the selected dotting event information is not matched with the preset configuration information, then
Writing unmatched dotting event information into a cache database;
inquiring dotting event information meeting time error conditions with the time information from the cache database according to the time information of the preset configuration information;
judging whether the queried dotting event information is matched with the preset configuration information;
If yes, confirming and selecting matched dotting event information.
6. The method of any one of claims 1 to 5, wherein prior to storing the matched dotting event information in a data warehouse, the method comprises:
when the matched dotting event information is selected, encrypting the matched dotting event information;
writing the encrypted dotting event information into a system log in real time;
the storing of the matched dotting event information in the data warehouse comprises:
and storing the encrypted dotting event information in the system log into the data warehouse in batches at a preset time point or when the number of the encrypted dotting event information in the system log exceeds a preset value.
7. A dotting event information collection device, the device comprising:
the information receiving module is used for receiving a control information set and an interface calling information set which are sent by a client, wherein the control information in the control information set is used for controlling a service agent running on the client, and the interface calling information in the interface calling information set is information for calling an interface of the client;
The configuration file generation module is used for selecting control information and interface call information which are matched in capturing time from the control information set and the interface call information set, the control information in the control information set and the interface call information in the interface call information set are arranged according to the capturing time of millisecond level, and the capturing time is the time when the client captures the control information or the interface call information; defining the matched control information and interface call information as dotting event information; adding an event tag to the dotting event information; the dotting event information existing in the control information set and the interface calling information set is arranged according to corresponding event labels, and an automatic dotting configuration file is generated;
the configuration file feedback module is used for feeding back the automatic dotting configuration file to the client;
the information receiving module is further used for receiving dotting event information monitored by the client through the automatic dotting configuration file;
the information selection module is used for selecting matched dotting event information from the received dotting event information through preset configuration information;
And the information storage module is used for storing the matched dotting event information into the data warehouse.
8. The apparatus of claim 7, wherein the information receiving module is further configured to receive element information sent by the client, the element information being captured by the client through a listening event, the listening event being registered by the client according to the automated dotting profile;
the apparatus further comprises: and the information analysis module is used for analyzing the element information to obtain dotting event information.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.
CN201810546986.0A 2018-05-31 2018-05-31 Dotting event information acquisition method and device, computer equipment and storage medium Active CN108920355B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810546986.0A CN108920355B (en) 2018-05-31 2018-05-31 Dotting event information acquisition method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810546986.0A CN108920355B (en) 2018-05-31 2018-05-31 Dotting event information acquisition method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108920355A CN108920355A (en) 2018-11-30
CN108920355B true CN108920355B (en) 2024-02-02

Family

ID=64419824

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810546986.0A Active CN108920355B (en) 2018-05-31 2018-05-31 Dotting event information acquisition method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108920355B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116708063A (en) * 2022-12-23 2023-09-05 荣耀终端有限公司 Log reporting method, electronic equipment, cloud server and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106452916A (en) * 2016-11-21 2017-02-22 北京小米移动软件有限公司 Method and device for acquiring service quality information, client and server
CN106844217A (en) * 2017-01-26 2017-06-13 网易(杭州)网络有限公司 Control to applying bury method and device, readable storage medium storing program for executing a little
CN107145489A (en) * 2016-03-01 2017-09-08 阿里巴巴集团控股有限公司 A kind of information statistical method and device of the client application based on cloud platform
CN107562620A (en) * 2017-08-24 2018-01-09 阿里巴巴集团控股有限公司 One kind buries an automatic setting method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107145489A (en) * 2016-03-01 2017-09-08 阿里巴巴集团控股有限公司 A kind of information statistical method and device of the client application based on cloud platform
CN106452916A (en) * 2016-11-21 2017-02-22 北京小米移动软件有限公司 Method and device for acquiring service quality information, client and server
CN106844217A (en) * 2017-01-26 2017-06-13 网易(杭州)网络有限公司 Control to applying bury method and device, readable storage medium storing program for executing a little
CN107562620A (en) * 2017-08-24 2018-01-09 阿里巴巴集团控股有限公司 One kind buries an automatic setting method and device

Also Published As

Publication number Publication date
CN108920355A (en) 2018-11-30

Similar Documents

Publication Publication Date Title
CN110647438B (en) Event monitoring method and device, computer equipment and storage medium
CN108874926B (en) Mass data query method, device, computer equipment and storage medium
CN110008118B (en) Page data testing method and device, computer equipment and storage medium
CN110290212B (en) Service call recording method, device, computer equipment and storage medium
CN109474578B (en) Message checking method, device, computer equipment and storage medium
CN110209652B (en) Data table migration method, device, computer equipment and storage medium
CN108667721B (en) Subscription report generation method and device, computer equipment and storage medium
CN109766534B (en) Report generation method and device, computer equipment and readable storage medium
CN110266752B (en) Block chain information pushing method and device, computer equipment and storage medium
CN109766253B (en) Performance data sending method and device, computer equipment and storage medium
CN111310427A (en) Service data configuration processing method and device, computer equipment and storage medium
CN110223133B (en) Product display method, device, computer equipment and storage medium
CN110688598B (en) Service parameter acquisition method and device, computer equipment and storage medium
CN113687974B (en) Client log processing method and device and computer equipment
CN110866198A (en) Static resource caching method, system, device, computer equipment and storage medium
CN111324905A (en) Image data labeling method and device, computer equipment and storage medium
CN110727567A (en) Software quality detection method and device, computer equipment and storage medium
CN110837956A (en) Underground cable inspection task distribution method and device
CN112506481A (en) Service data interaction method and device, computer equipment and storage medium
CN111666298A (en) Method and device for detecting user service class based on flink, and computer equipment
CN112114994A (en) Exception handling method, device, equipment and medium
CN108920355B (en) Dotting event information acquisition method and device, computer equipment and storage medium
CN112866319A (en) Log data processing method, system and storage medium
CN110765131B (en) Data compression method and device for goods source data, computer equipment and storage medium
CN114327374A (en) Business process generation method and device and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant