CN109561117B - Data acquisition method and device - Google Patents
Data acquisition method and device Download PDFInfo
- Publication number
- CN109561117B CN109561117B CN201710880787.9A CN201710880787A CN109561117B CN 109561117 B CN109561117 B CN 109561117B CN 201710880787 A CN201710880787 A CN 201710880787A CN 109561117 B CN109561117 B CN 109561117B
- Authority
- CN
- China
- Prior art keywords
- target element
- identification information
- configuration file
- data
- event data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/535—Tracking the activity of the user
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The data acquisition method provided by the invention firstly obtains the operation instruction of the user on the element displayed by the client device; then determining whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file, if so, acquiring event data corresponding to the target element; and finally, sending the event data to the server. The invention sends the event data, the data volume of the event data is much smaller than that of the full data, and only the event data of the target element matched with the identification information in the configuration file is sent, so the transmission quantity of the data is greatly reduced, and the network burden is reduced.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a data acquisition method and device.
Background
With the continuous development of the internet and the popularization of intelligent terminals, all big electronic commerce and internet enterprises have own APP clients, such as Jingdong, Taobao and the like.
When a user clicks and selects an element (such as a button, a picture or a character) in the APP client, the generated data is user behavior data. The data analysis of the user behavior data is very important for enterprises and can provide a basis for future market decision, and the premise of the data analysis is to collect the user behavior data.
In the prior art, a method for collecting user behavior data is generally a method for collecting data without a buried point, where data collected without a buried point refers to collecting, by a server, full data generated when a user operates any element in an APP client, where the full data includes attribute data of the element itself and context data of the element when the element is operated.
It can be seen that the existing data collecting mode without a buried point needs to collect the full data operated by a user, and if the full data collected by the prior art is transmitted (for example, transmitted to a data analysis device), more data traffic needs to be consumed.
Of course, in addition to the above problems with the full amount of data generated by the APP client operation, the same problems may exist with the full amount of data generated by other interfaces, such as web page operations.
Disclosure of Invention
In view of the above problems, the present invention is proposed to provide a user behavior data collecting method and device for reducing the traffic of transmission data and reducing the network load, which overcome the above problems or at least partially solve the above problems.
In order to achieve the purpose, the invention provides the following technical scheme:
the invention provides a data acquisition method, which is applied to client equipment and comprises the following steps:
obtaining an operation instruction of a user on an element displayed by the client device;
determining whether the identification information of the target element operated by the operation instruction is the identification information of elements in a pre-stored configuration file, if so, acquiring event data corresponding to the target element;
and sending the event data to the server.
Optionally, the method further includes:
determining context information of the target element if the identification information of the target element is not the identification information of the element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
and sending the context information to the server.
Optionally, before determining whether the identification information of the target element operated by the operation instruction is the identification information of an element in a pre-stored configuration file, the method further includes:
receiving a setting instruction of a user;
displaying a configuration interface corresponding to the setting instruction according to the setting instruction, wherein elements in the configuration interface correspond to elements displayed by the client equipment;
receiving a configuration operation of a user on an element in the configuration interface;
generating a configuration file according to the configuration operation, wherein the configuration file comprises the identification information of the elements;
storing the configuration file in a storage space of the client device.
Optionally, the method further includes:
and uploading the configuration file to a server so that the server stores the configuration file.
Optionally, the sending the event data to the server includes:
acquiring the connection state of the client equipment;
judging whether the connection is wifi connection;
and if so, sending the event data to the server.
Optionally, the sending the event data to the server further includes:
acquiring a character replacement rule in the configuration file, wherein the character replacement rule comprises a replacement relation between a long character string and a short character string;
replacing the long character string which accords with the character replacement rule in the event data with a short character string according to the replacement relation to obtain compressed event data;
transmitting the compressed event data to a server.
In another aspect, the present invention provides a data acquisition device applied to a client device, the data acquisition device comprising:
the instruction acquisition module is used for acquiring an operation instruction of the user on the elements displayed by the client equipment;
the first execution module is used for determining whether the identification information of the target element operated by the operation instruction is the identification information of elements in a pre-stored configuration file, and if so, acquiring event data corresponding to the target element;
and the event data sending module is used for sending the event data to the server.
Optionally, the method further includes:
a second execution module, configured to determine context information of the target element if the identification information of the target element is not the identification information of an element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
and the context information sending module is used for sending the context information to the server.
In another aspect, the present invention provides a storage medium, which includes a stored program, wherein the program executes the data acquisition method described above.
In another aspect, the present invention provides a processor, where the processor is configured to execute a program, where the program executes the data acquisition method described above.
By means of the technical scheme, the data acquisition method provided by the invention firstly obtains the operation instruction of the user on the element displayed by the client equipment; then determining whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file, if so, acquiring event data corresponding to the target element; and finally, sending the event data to the server. The invention sends the event data, the data volume of the event data is much smaller than that of the full data, and only the event data of the target element matched with the identification information in the configuration file is sent, so the transmission quantity of the data is greatly reduced, and the network burden is reduced.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a flow chart of a data acquisition method disclosed in an embodiment of the present invention;
FIG. 2 is a schematic flow chart diagram illustrating another data collection method disclosed in an embodiment of the present invention;
FIG. 3 is a schematic flow chart illustrating a process of storing configuration files in a data collection method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a data acquisition device according to an embodiment of the present invention;
fig. 5 shows a hardware structure diagram of a data acquisition device disclosed by the embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The embodiment of the invention discloses a data acquisition method which can be applied to client equipment, wherein the client equipment can be an APP client and can also be a client of a webpage end, and the data acquisition method is preferably applied to the APP client.
The client device is connected to a server, which may be a data server or a data analysis server, and is configured to perform data analysis and other processing on the acquired data.
The client device stores a configuration file, and the configuration file comprises identification information of the target element. In the embodiment of the invention, the storage space of the client device, such as a hard disk, is stored with the configuration file, the configuration file is used for providing a collection basis and a collection basis for data collection, and the contained identification information is unique identification information for distinguishing each element. The specific way of establishing the configuration file is described in detail later.
Referring to fig. 1, fig. 1 shows a schematic flow chart of a data acquisition method disclosed in the embodiment of the present invention.
The data acquisition method provided by the invention can comprise the following steps:
s100, obtaining an operation instruction of a user on an element displayed by client equipment;
in the embodiment of the invention, a plurality of elements such as pictures, buttons, characters and the like can be displayed in the client device, a user executes operations such as clicking, double clicking and the like on the displayed elements, and the client device receives an operation instruction corresponding to the operations.
Taking the APP client as an example, when an enterprise issues a new activity through the client, the activity is specifically in the form of a page displayed in the APP client. The page comprises a plurality of buttons, pictures and other elements, and a user operates a certain target element according to own requirements, for example, clicks a payment button, and at this time, an operation instruction corresponding to the clicking operation is generated. The client device obtains the operating instruction.
S101, determining whether identification information of a target element operated by an operation instruction is identification information of an element in a pre-stored configuration file, and if so, acquiring event data corresponding to the target element;
in the embodiment of the invention, whether the target element operated by the user is an element which needs to collect user behavior data needs to be determined, so that whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file is determined.
Specifically, the identification information of the target element is obtained, whether the identification information of the target element is matched with the identification information in the configuration file is judged, if yes, the target element is determined to be an element needing to collect user behavior data, and event data corresponding to the target element is obtained.
It should be noted that, the method for acquiring the identification information of the target element is consistent with the method for generating the identification information in the configuration file, as long as the same algorithm or manner can be used to acquire the identification information. The specific process is described in detail later.
In actual use, the identification information may specifically be text information of the target element, page information of a page where the target element is located, context information of the target element, and the like.
The manner of acquiring the event data may include:
acquiring an operation event in the operation instruction; the operation event can include any one of clicking, double-clicking, selecting, right-click clicking, right-click double-clicking and the like.
And searching the source code of the target element according to the operation event in the operation instruction to obtain the event data of the target element. For example, the event data is jump data, URL: htm. The URL is the event data of the target element corresponding to the operation instruction.
It can be understood that the above-mentioned manner is only one manner of obtaining event data, and as long as the event data corresponding to the target element can be obtained, the details are not described herein.
It will be appreciated that the event data may also include callback data, gesture data, etc., where the gesture data is specific to, for example, a pinch, a swipe, etc.
It should be noted that, in the embodiment of the present invention, if it is determined that the identification information of the target element operated by the operation instruction is not the identification information in the configuration file, any data may not be acquired, and any operation related to the acquired data is not performed; of course, the full amount of data may also be sent to the server as in the prior art.
And S102, sending the event data to a server.
Finally, the event data is sent to the server so that the server can save or analyze the event data. Compared with the full data, the event data has much smaller data volume, reflects the specific behavior of the user intuitively, does not reflect the specific operation executed by the user like the full data, and needs to perform algorithm analysis, so that the specific behavior of the user can be seen more intuitively without further analysis, and the work efficiency of analyzing the data is improved.
It is understood that, before step 100, the data acquisition method of the present invention may further include:
and acquiring configuration information of the configuration file, judging whether to start the step S100 according to the configuration information, and if not, sending full data to a server after acquiring an operation instruction of the user on the elements displayed by the client equipment.
It can be seen that, the data acquisition method provided by the invention firstly obtains the operation instruction of the user on the element displayed by the client device; then determining whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file, if so, acquiring event data corresponding to the target element; and finally, sending the event data to the server. The invention sends the event data, the data volume of the event data is much smaller than that of the full data, and only the event data of the target element matched with the identification information in the configuration file is sent, so the transmission quantity of the data is greatly reduced, and the network burden is reduced.
On the basis of the above embodiment, the invention provides another data acquisition method.
Referring to fig. 2, fig. 2 is a schematic flow chart of another data acquisition method disclosed in the embodiment of the invention.
The data acquisition method comprises the following steps:
s201, obtaining an operation instruction of a user on an element displayed by client equipment;
s202, determining whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file;
and S203, if so, acquiring event data corresponding to the target element, and sending the event data to a server.
Steps S201 to S203 may refer to steps S101 to S103 in the foregoing embodiment, which are not described herein again.
S204, if the identification information of the target element is not the identification information of the element in the configuration file, determining the context information of the target element; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located; the context information is sent to the server.
In the embodiment of the invention, if the identification information of the target element operated by the operation instruction is determined not to be the identification information in the configuration file, the context information of the target element is determined, wherein the context information is other content information of the page where the target element is located. For example, a "buy" button element is a context for other content information of the page where the button element is located, such as the name of the goods, price, comments, etc. of the page where the button element is located.
The specific method for acquiring the context information comprises traversing all elements of the current page, and acquiring information such as texts, names, labels, unique identifiers and the like of all the elements.
And after the context information is acquired, sending the context information to a server so that the server stores the context information. The function of obtaining the context information is to obtain the unique identifier through the context information, and if the unique identifier is configured in the configuration file at a later stage, historical event data can be traced back through the historical context information.
The server can convert the data of the whole amount of data stored in advance into the event data by using a specific time as a trigger. The pre-saved full data is the full data saved in a preset time period. It is understood that the conversion of the total data into the event data is a mature technology in the prior art and will not be described herein. The specific time may include converting the pre-saved full amount of data into event data when the server receives the context information.
It can be seen that, in the embodiment of the present invention, when the configuration file does not include the identification information of the element corresponding to the operation instruction, the context information is collected and sent to the server, which is more favorable for subsequent data analysis.
Fig. 3 is a schematic flow chart illustrating a process of storing a configuration file in a data acquisition method according to an embodiment of the present invention.
In the above embodiment, the configuration file is stored in the client device, and the process of storing the configuration file is specifically described below.
The storage process of the configuration file comprises the following steps:
s300, receiving a setting instruction of a user;
s301, displaying a configuration interface corresponding to the setting instruction according to the setting instruction, wherein elements in the configuration interface correspond to elements displayed by the client equipment;
in the embodiment of the invention, the configuration file can be set at the front end, and the setting instruction of the user is received. The setting instruction may be an instruction corresponding to a specific gesture track, or a setting instruction issued when a user clicks a button, or a setting instruction generated by scanning a specific two-dimensional code through a scanning function of the APP, as long as the setting instruction of the user can be received, and no specific limitation is performed.
It can be understood that the method may further include authentication of the user, and if the user is a normal user, the step S301 is not executed, and the process of performing authentication belongs to a mature technology in the prior art and is not described herein.
After receiving the setting instruction, calling a configuration interface, wherein the configuration interface is the same as an interface displayed by the client device, includes the same elements, and has the same positions and sizes, and the difference is that configuration operation is performed when the element is operated.
It is understood that only elements that can perform operations may be displayed in the configuration interface, and for example, after the elements are clicked, the corresponding configuration may be completed. Or individual elements may be displayed in a list.
S302, receiving configuration operation of a user on elements in a configuration interface;
s303, generating a configuration file according to the configuration operation;
after the user performs the required configuration operation on the elements in the configuration interface, a configuration file is generated, which includes the identification information of the configured configuration elements.
The method for generating the identification information may include obtaining context information of a page where the element is located, and generating the identification information of the element according to the context information and a generation algorithm. That is, the identification information is generated according to the information of the page where the element is located, and the identification information is different between the elements. It is understood that a data collection mode when no identification information is set may also be set, such as collecting the full amount of data.
S304, storing the configuration file in a storage space of the client device.
S305, uploading the configuration file to a service, so that the server stores the configuration file.
After the configuration file is generated, the configuration file is stored in a storage space, where the storage space may be a cloud storage space or a hardware storage space of the device itself, and is not particularly limited.
The configuration file can also be uploaded to a server, and when other clients log in, the configuration file is acquired first and then the process after execution is performed. It will be appreciated that the configuration file may also be written and/or rewritten directly in the server side of the back-end.
It can be understood that, after being uploaded to the server, when other client devices log in the server, it is first determined whether the configuration file is consistent with the configuration file stored in the client device, if so, the configuration file is proved to be updated, and if not, the configuration file is downloaded, so that the stored configuration file is the latest. It is to be understood that the process of determining whether the process is the latest process may use various manners, such as determining a version number or a build date in a configuration file, and the like, and is not particularly limited herein.
It can be seen that, due to the configuration file, the elements to be collected can be freely set, the flexibility is improved, and the configuration file can be rewritten in the front-end client device and the back-end server, so that the flexibility is further improved.
Optionally, the sending the operation event to the server includes:
acquiring the connection state of the client equipment;
judging whether the connection is wifi connection;
if so, sending the operation event data to the server, and if the operation event data is in a wifi connection state, sending the event data to the server.
If the data is not in the wifi connection state, storing the event data and/or the context information in a cache, and simultaneously recording the time of the data cache, and after the wifi connection, sending the data in the cache and the recorded time data to the server, so that the server can restore to a correct time point according to the time data when receiving the data.
It is understood that data unrelated to data acquisition, such as page browsing, e-commerce, etc., can be normally transmitted. Reducing the flow of the user when using 4G.
Further, due to some characteristics of APP and web page, there is a common existence in the page where the event occurs, for example, in the Android system, most pages are Activity-ended, such as MainActivity, query Activity, location Activity, etc., and then this character string of Activity may be replaced by other character strings, such as @ |. Then the total data amount can be reduced from 8 bytes to 3 bytes. For another example, the iOS may include a ViewController, a WebViewController, and the like, which may compress the ViewController string.
Therefore, in the technical solution of the present invention, the configuration file may further include a character replacement rule, where the replacement rule is used to replace a specific character in the event data and/or the context information, and the method may further include:
and replacing characters which accord with the character replacement rule in the event data and/or the context information according to the character replacement rule in the configuration file.
It should be noted that when the server receives the processed event data and/or context information, the event data and/or context information is also restored according to the character replacement rule.
It can be seen that through the above operation, the flow rate of the transmission data can be further reduced.
In another aspect, the invention provides a data acquisition device.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a data acquisition device according to the present invention.
The invention provides a data acquisition device applied to client equipment, which comprises:
the instruction acquisition module 1 is used for acquiring an operation instruction of a user on an element displayed by the client device;
the first execution module 2 is configured to determine whether identification information of a target element operated by an operation instruction is identification information of an element in a pre-stored configuration file, and if so, obtain event data corresponding to the target element;
and the event data sending module 3 is used for sending the event data to the server.
Optionally, the method further includes:
a second executing module 4, configured to determine context information of the target element if the identification information of the target element is not the identification information of an element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
and the context information sending module 5 is used for sending the context information to the server.
The invention provides a data acquisition device instruction acquisition module 1, which acquires an operation instruction of a user on an element displayed by client equipment; the first execution module 2 determines whether the identification information of the target element operated by the operation instruction is the identification information in the configuration file, and if so, acquires event data corresponding to the target element; and the event data sending module 3 sends the event data to the server. The invention sends the event data, the data volume of the event data is much smaller than that of the full data, and only the event data of the target element matched with the identification information in the configuration file is sent, so the transmission quantity of the data is greatly reduced, and the network burden is reduced.
Referring to fig. 5, fig. 5 is a schematic diagram of a hardware structure of a data acquisition device according to an embodiment of the present invention.
The data acquisition device comprises a processor 500 and a memory 600, wherein the instruction acquisition module 1, the first execution module 2, the event data transmission module 3, the second execution module 4, the context information transmission module 5 and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, the flow of transmission data is reduced by adjusting kernel parameters, and the network burden is reduced. .
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
An embodiment of the present invention provides a storage medium on which a program is stored, the program implementing a data acquisition method when executed by a processor.
The embodiment of the invention provides a processor, which is used for running a program, wherein a data acquisition method is executed when the program runs.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: obtaining an operation instruction of a user on an element displayed by client equipment;
determining whether the identification information of the target element operated by the operation instruction is the identification information of the element in the pre-stored configuration file, if so, acquiring event data corresponding to the target element;
and sending the event data to a server.
Optionally, the method further includes:
determining context information of the target element if the identification information of the target element is not the identification information of the element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
the context information is sent to the server.
Optionally, before determining whether the identification information of the target element operated by the operation instruction is the identification information of an element in the pre-stored configuration file, the method further includes:
receiving a setting instruction of a user;
displaying a configuration interface corresponding to the setting instruction according to the setting instruction, wherein elements in the configuration interface correspond to elements displayed by the client equipment;
receiving a configuration operation of a user on an element in a configuration interface;
generating a configuration file according to the configuration operation, wherein the configuration file comprises identification information of elements;
the configuration file is stored in a storage space of the client device.
Optionally, the method further includes:
and uploading the configuration file to the server so that the server stores the configuration file.
Optionally, the sending the event data to the server includes:
acquiring a connection state of client equipment;
judging whether the connection is wifi connection;
and if so, sending the event data to the server.
Optionally, the sending the event data to the server further includes:
acquiring a character replacement rule in the configuration file, wherein the character replacement rule comprises a replacement relation between a long character string and a short character string;
replacing the long character string which accords with the character replacement rule in the event data with a short character string according to the replacement relation to obtain compressed event data;
the compressed event data is sent to the server.
The device herein may be a server, a PC, a PAD, a mobile phone, etc.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device:
obtaining an operation instruction of a user on an element displayed by client equipment;
determining whether the identification information of the target element operated by the operation instruction is the identification information of the element in the pre-stored configuration file, if so, acquiring event data corresponding to the target element;
and sending the event data to a server.
Optionally, the method further includes:
determining context information of the target element if the identification information of the target element is not the identification information of the element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
the context information is sent to the server.
Optionally, before determining whether the identification information of the target element operated by the operation instruction is the identification information of an element in the pre-stored configuration file, the method further includes:
receiving a setting instruction of a user;
displaying a configuration interface corresponding to the setting instruction according to the setting instruction, wherein elements in the configuration interface correspond to elements displayed by the client equipment;
receiving a configuration operation of a user on an element in a configuration interface;
generating a configuration file according to the configuration operation, wherein the configuration file comprises identification information of elements;
the configuration file is stored in a storage space of the client device.
Optionally, the method further includes:
and uploading the configuration file to the server so that the server stores the configuration file.
Optionally, the sending the event data to the server includes:
acquiring a connection state of client equipment;
judging whether the connection is wifi connection;
and if so, sending the event data to the server.
Optionally, the sending the event data to the server further includes:
acquiring a character replacement rule in the configuration file, wherein the character replacement rule comprises a replacement relation between a long character string and a short character string;
replacing the long character string which accords with the character replacement rule in the event data with a short character string according to the replacement relation to obtain compressed event data;
the compressed event data is sent to the server.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A data acquisition method is applied to client equipment, and the method comprises the following steps:
obtaining an operation instruction of a user on an element displayed by the client device;
determining whether the identification information of the target element operated by the operation instruction is the identification information of elements in a pre-stored configuration file, if so, acquiring event data corresponding to the target element; the method for acquiring the identification information of the target element is consistent with the method for generating the identification information of the element in the configuration file, wherein the identification information comprises one or more of text information of the target element, page information of a page where the target element is located and context information of the target element;
and sending the event data to a server.
2. The data acquisition method of claim 1, further comprising:
determining context information of the target element if the identification information of the target element is not the identification information of the element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
and sending the context information to the server.
3. The data acquisition method according to claim 1, wherein before determining whether the identification information of the target element operated by the operation instruction is the identification information of an element in a pre-stored configuration file, the method further comprises:
receiving a setting instruction of a user;
displaying a configuration interface corresponding to the setting instruction according to the setting instruction, wherein elements in the configuration interface correspond to elements displayed by the client equipment;
receiving a configuration operation of a user on an element in the configuration interface;
generating a configuration file according to the configuration operation, wherein the configuration file comprises the identification information of the elements;
storing the configuration file in a storage space of the client device.
4. The data acquisition method of claim 3, further comprising:
and uploading the configuration file to a server so that the server stores the configuration file.
5. The data collection method of any one of claims 1 to 4, wherein the sending the event data to a server comprises:
acquiring the connection state of the client equipment;
judging whether the connection is wifi connection;
and if so, sending the event data to the server.
6. The data collection method of claim 5, wherein sending the event data to the server further comprises:
acquiring a character replacement rule in the configuration file, wherein the character replacement rule comprises a replacement relation between a long character string and a short character string;
replacing the long character string which accords with the character replacement rule in the event data with a short character string according to the replacement relation to obtain compressed event data;
transmitting the compressed event data to a server.
7. A data acquisition device, applied to a client device, the data acquisition device comprising:
the instruction acquisition module is used for acquiring an operation instruction of the user on the elements displayed by the client equipment;
the first execution module is used for determining whether the identification information of the target element operated by the operation instruction is the identification information of elements in a pre-stored configuration file, and if so, acquiring event data corresponding to the target element; the method for acquiring the identification information of the target element is consistent with the method for generating the identification information of the element in the configuration file, wherein the identification information comprises one or more of text information of the target element, page information of a page where the target element is located and context information of the target element;
and the event data sending module is used for sending the event data to a server.
8. The acquisition device of claim 7, further comprising:
a second execution module, configured to determine context information of the target element if the identification information of the target element is not the identification information of an element in the configuration file; the context information is used for representing other information except the attribute information of the target element in the page where the target element is located;
and the context information sending module is used for sending the context information to the server.
9. A storage medium characterized in that it comprises a stored program, wherein the program executes the data acquisition method of any one of claims 1 to 6.
10. A processor, characterized in that the processor is configured to run a program, wherein the program is configured to execute the data acquisition method according to any one of claims 1 to 6 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710880787.9A CN109561117B (en) | 2017-09-26 | 2017-09-26 | Data acquisition method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710880787.9A CN109561117B (en) | 2017-09-26 | 2017-09-26 | Data acquisition method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109561117A CN109561117A (en) | 2019-04-02 |
| CN109561117B true CN109561117B (en) | 2022-02-25 |
Family
ID=65862036
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710880787.9A Active CN109561117B (en) | 2017-09-26 | 2017-09-26 | Data acquisition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109561117B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112198818B (en) * | 2019-07-08 | 2022-05-13 | 浙江宇视科技有限公司 | Control method, device and equipment of stepping type driving structure and storage medium |
| CN110413933A (en) * | 2019-08-05 | 2019-11-05 | 青岛聚好联科技有限公司 | The method and device of point data is buried in a kind of server-side acquisition |
| CN110704270A (en) * | 2019-08-20 | 2020-01-17 | 北京奇艺世纪科技有限公司 | Zero-buried point data acquisition method and device, electronic equipment and storage medium |
| CN110704709B (en) * | 2019-08-27 | 2021-01-26 | 北京金堤科技有限公司 | Application data capturing method and device, storage medium and electronic equipment |
| CN110515679B (en) * | 2019-08-28 | 2023-09-19 | 北京思维造物信息科技股份有限公司 | Data acquisition method, device, equipment and storage medium |
| CN112968933B (en) * | 2021-01-29 | 2023-03-14 | 北京达佳互联信息技术有限公司 | Data transmission method, device, server and storage medium |
| CN113377631A (en) * | 2021-05-25 | 2021-09-10 | 北京猿力教育科技有限公司 | User behavior backtracking method and device |
| CN114677188B (en) * | 2022-05-25 | 2022-08-26 | 国网浙江省电力有限公司 | Full-amount acquisition method and device suitable for paperless certificate data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102946319A (en) * | 2012-09-29 | 2013-02-27 | 焦点科技股份有限公司 | System and method for analyzing network user behavior information |
| CN104834657A (en) * | 2014-08-27 | 2015-08-12 | 腾讯科技（北京）有限公司 | User behavior analysis method and servers |
| CN105550184A (en) * | 2014-10-31 | 2016-05-04 | 阿里巴巴集团控股有限公司 | Information obtaining method and device |
| CN106202440A (en) * | 2016-07-13 | 2016-12-07 | 华为技术有限公司 | Data processing method, device and equipment |
| CN106708899A (en) * | 2015-11-17 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Automatic point burying device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001052141A1 (en) * | 2000-01-07 | 2001-07-19 | Mp3.Com, Inc. | System and method for providing access to electronic works |
| US7562387B2 (en) * | 2001-09-07 | 2009-07-14 | International Business Machines Corporation | Method and apparatus for selective disabling of tracking of click stream data |
| US20080027895A1 (en) * | 2006-07-28 | 2008-01-31 | Jean-Christophe Combaz | System for searching, collecting and organizing data elements from electronic documents |
| CN104346374A (en) * | 2013-07-31 | 2015-02-11 | 阿里巴巴集团控股有限公司 | Data processing method and system |
| CN103927367A (en) * | 2014-04-22 | 2014-07-16 | 上海数据分析与处理技术研究所 | Microblog acquisition system and method based on events |
| CN106547914B (en) * | 2016-11-25 | 2020-08-18 | 国信优易数据有限公司 | Data acquisition management system and method thereof |
| CN106933722B (en) * | 2017-03-06 | 2019-12-31 | 腾云天宇科技（北京）有限公司 | Webpage application monitoring method, server and system |
-
2017
- 2017-09-26 CN CN201710880787.9A patent/CN109561117B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102946319A (en) * | 2012-09-29 | 2013-02-27 | 焦点科技股份有限公司 | System and method for analyzing network user behavior information |
| CN104834657A (en) * | 2014-08-27 | 2015-08-12 | 腾讯科技（北京）有限公司 | User behavior analysis method and servers |
| CN105550184A (en) * | 2014-10-31 | 2016-05-04 | 阿里巴巴集团控股有限公司 | Information obtaining method and device |
| CN106708899A (en) * | 2015-11-17 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Automatic point burying device |
| CN106202440A (en) * | 2016-07-13 | 2016-12-07 | 华为技术有限公司 | Data processing method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109561117A (en) | 2019-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109561117B (en) | Data acquisition method and device | |
| CN107145489B (en) | Information statistics method and device for client application based on cloud platform | |
| CN101635655B (en) | Method, device and system for page performance test | |
| CN104981768B (en) | Stream data receiver and save routine based on cloud | |
| US20200357007A1 (en) | Page data acquisition method, apparatus, server, electronic device and computer readable medium | |
| CN102567516B (en) | Script loading method and device | |
| CN102999314A (en) | Immediate delay tracker tool | |
| CN105493028A (en) | Data consistency and rollback for cloud analytics | |
| KR102391839B1 (en) | Method and device for processing user personal, server and storage medium | |
| CN106886545B (en) | Page display method, page resource caching method and device | |
| CN109002282B (en) | Method and device for realizing animation effect in web page development | |
| CN106919620B (en) | Single page processing method and device | |
| CN107220260B (en) | Page display method and device | |
| CN114528813A (en) | File conversion management method, device, equipment and medium for online preview | |
| CN112817817B (en) | Buried point information query method, buried point information query device, computer equipment and storage medium | |
| CN114547514A (en) | Dynamic rendering method, device, equipment and medium for components | |
| CN110858238B (en) | Data processing method and device | |
| CN108984221B (en) | Method and device for acquiring multi-platform user behavior logs | |
| CN111061977A (en) | Website updating method, device and system | |
| CN115905151A (en) | Method, system and device for querying circulation information based on backup log | |
| CN115757639A (en) | Data source synchronization method and device, electronic equipment and storage medium | |
| CN102694802B (en) | Network access information recording method and device | |
| CN114385128A (en) | Data processing method, device, apparatus, storage medium and program product | |
| CN114020565A (en) | Intelligent log collection processing method and device, electronic equipment and storage medium | |
| TW201905669A (en) | APP application display interface method, device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100080 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing Applicant after: Beijing Guoshuang Technology Co.,Ltd. Address before: 100086 Beijing city Haidian District Shuangyushu Area No. 76 Zhichun Road cuigongfandian 8 layer A Applicant before: Beijing Guoshuang Technology Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |