CN108023788B - Monitoring data uploading method, device, equipment, system and storage medium - Google Patents
Monitoring data uploading method, device, equipment, system and storage medium Download PDFInfo
- Publication number
- CN108023788B CN108023788B CN201711233076.9A CN201711233076A CN108023788B CN 108023788 B CN108023788 B CN 108023788B CN 201711233076 A CN201711233076 A CN 201711233076A CN 108023788 B CN108023788 B CN 108023788B
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring data
- equipment
- uploading
- association
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/02—Capturing of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a monitoring data uploading method, which comprises the following steps: when the application program is started, reporting equipment information of equipment where the application program is located to a background server for one time and storing the equipment information; judging whether the current variable data of the equipment is changed or not; if yes, generating a new association code and storing the new association code in association with the changed volatile data; during the period that the variable data is not changed, all event monitoring data to be reported in the period are stored in a correlation mode with the current latest correlation code; when the data is reported, the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code are assembled and compressed according to a preset format to obtain a monitoring data packet and are uploaded to the background server. The invention also discloses a monitoring data uploading device, equipment, a system and a readable storage medium. The invention can ensure the integrity of the monitored data and reduce the repeated uploading of redundant data, thereby saving the flow for users.
Description
Technical Field
The present invention relates to the field of application performance monitoring technologies, and in particular, to a method, an apparatus, a device, a system, and a computer-readable storage medium for uploading monitored data.
Background
Generally, an APP operator can continuously improve the performance of an APP for the following, and therefore needs to obtain performance data in the running process of the APP, that is, the APP operator needs to actively monitor an APP user side to obtain performance monitoring data of the APP.
When the user end device reports the performance monitoring data of the APP, each piece of data needs to be independent and complete, each piece of data contains device information, a network state and the like, and the integrity facilitates subsequent data analysis. However, each piece of reported data usually contains some data that is not changed permanently or for a while, that is, there are data reported repeatedly. If each piece of data carries complete information when it is reported, it will take a significant amount of traffic to report these repeated pieces of data.
Disclosure of Invention
The invention mainly aims to provide a method, a device, equipment and a system for uploading monitoring data and a computer readable storage medium, and aims to solve the technical problem that the flow consumption of equipment at a reporting end is overlarge due to repeated reporting of repeated data in the conventional data reporting.
In order to achieve the above object, the present invention provides a monitoring data uploading method, which is applied to performance monitoring of an application program, and the monitoring data uploading method includes the following steps:
when the application program is started, reporting equipment information of equipment where the application program is located to a background server for one time and storing the equipment information;
judging whether the current variable data of the equipment changes or not in the running process of the application program;
if yes, generating a new association code and storing the new association code in association with the changed volatile data;
during the period that the variable data is not changed, all event monitoring data to be reported in the period are stored in a correlation mode with the current latest correlation code;
and when the data is reported, assembling and compressing the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code according to a preset format to obtain a monitoring data packet and uploading the monitoring data packet to the background server.
Optionally, the volatile data of the device includes at least: network type, IP address, device system language, device system time zone; the related information at least comprises: the device code of the device and the timestamp reported by the device information.
Optionally, the generating a new association code and storing the new association code in association with the changed volatile data includes:
and generating a new association code through a preset association code generator, and associating and storing the new association code with the changed volatile data when the volatile data is stored.
Optionally, when reporting the data, assembling and compressing the stored related information in the device information, the volatile data stored in association with the same association code, and the event monitoring data according to a preset format includes:
when data is reported, dividing variable data and event monitoring data which are stored in association with the same association code into a group of grouped data;
and at least assembling the equipment code of the equipment, the timestamp reported by the equipment information and at least one group of grouped data according to a preset JSON format, and compressing the assembled data.
Optionally, when the application is started, reporting the device information of the device where the application is located to the background server and storing the device information includes:
when the application program is started, judging whether the network type of the equipment where the current application program is positioned is a mobile communication network;
and if the network type of the current equipment is a mobile communication network, reporting equipment information of the equipment to a background server once and locally storing the equipment information.
Further, to achieve the above object, the present invention further provides a monitoring data uploading apparatus, which is applied to performance monitoring of an application program, and the monitoring data uploading apparatus includes:
the first reporting module is used for reporting the equipment information of the equipment where the application program is located to a background server and storing the equipment information when the application program is started;
the judging module is used for judging whether the current variable data of the equipment changes or not in the running process of the application program;
the first association module is used for generating a new association code and storing the new association code in association with the changed volatile data when the volatile data of the current equipment changes;
the second correlation module is used for correlating and storing all event monitoring data to be reported and the current latest correlation code in the period when the volatile data are not changed;
and the second reporting module is used for assembling and compressing the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code according to a preset format when the data are reported to obtain a monitoring data packet and uploading the monitoring data packet to the background server.
Further, to achieve the above object, the present invention further provides a monitoring data uploading device, including: the monitoring data uploading method comprises a memory, a processor and a monitoring data uploading program which is stored on the memory and can run on the processor, wherein when the monitoring data uploading program is executed by the processor, the steps of the monitoring data uploading method are realized.
Further, in order to achieve the above object, the present invention further provides a monitoring data uploading system, where the monitoring data uploading system includes a background server and the monitoring data uploading device;
the background server is wirelessly connected with the monitoring data uploading device and used for receiving the device information uploaded by the monitoring data uploading device and the monitoring data packet.
Optionally, the background server is further configured to:
decompressing the monitoring data packet to obtain volatile data, event monitoring data and related information in the equipment information;
inquiring the equipment information received by the background server based on the relevant information to obtain the equipment information corresponding to the variable data and the event monitoring data;
and assembling the obtained equipment information, the variable data and the event monitoring data to obtain a plurality of complete monitoring data and storing the complete monitoring data in a database of the background server.
Further, to achieve the above object, the present invention further provides a computer-readable storage medium, where a monitoring data uploading program is stored on the computer-readable storage medium, and when executed by the processor, the monitoring data uploading program implements the steps of the monitoring data uploading method according to any one of the above items.
In the invention, the data reported to the background is divided into two parts: the first part is unchanged data, including equipment information; the second part is changed data, including: short time invariant data such as network type, IP address, etc., and real time changing event monitoring data. In the APP operation process, the data of different parts are reported separately, for the first part of data, the data is reported once when the APP is started, and for the second part of data, packet reporting is adopted, short-time unchangeable data and a plurality of event monitoring data acquired in the short time are reported as the same packet data, and then the reporting of the same repeated data can be greatly reduced, so that the flow consumption of reporting end equipment is reduced, the flow overhead cost is saved for a user, and the performance influence on the reporting end equipment during data uploading can be reduced.
Drawings
FIG. 1 is a schematic diagram of a hardware operating environment of a device according to an embodiment of the present invention;
FIG. 2 is a functional block diagram of an embodiment of a system for monitoring data upload according to the present invention;
FIG. 3 is a flowchart illustrating a monitoring data uploading method according to an embodiment of the present invention;
fig. 4 is a schematic functional block diagram of a monitoring data uploading apparatus according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a hardware operating environment of a device according to an embodiment of the present invention.
The monitoring data uploading device can be a device with a display function, such as a smart phone, a tablet computer, a portable computer and the like.
As shown in fig. 1, the monitoring data uploading device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a memory device separate from the processor 1001 described above.
Those skilled in the art will appreciate that the hardware configuration of the monitoring data uploading device shown in fig. 1 does not constitute a limitation of the monitoring data uploading device, and may include more or less components than those shown, or combine some components, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a user interface module, and a monitoring data upload program. The operating system is a program for managing and controlling the monitoring data uploading equipment and software resources, and supports the running of a network communication module, a user interface module, a monitoring data uploading program and other programs or software; the network communication module is used for managing and controlling the network interface 1002; the user interface module is used to manage and control the user interface 1003.
In the hardware structure of the monitoring data uploading device shown in fig. 1, the network interface 1004 is mainly used for connecting to a system background and performing data communication with the system background; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; the monitoring data upload device calls the monitoring data upload program stored in the memory 1005 by the processor 1001, and performs the following steps:
when the application program is started, reporting equipment information of equipment where the application program is located to a background server for one time and storing the equipment information;
judging whether the current variable data of the equipment changes or not in the running process of the application program;
if yes, generating a new association code and storing the new association code in association with the changed volatile data;
during the period that the variable data is not changed, all event monitoring data to be reported in the period are stored in a correlation mode with the current latest correlation code;
and when the data is reported, assembling and compressing the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code according to a preset format to obtain a monitoring data packet and uploading the monitoring data packet to the background server.
Further, the monitoring data uploading device calls the monitoring data uploading program stored in the memory 1005 through the processor 1001 to perform the following operations:
when data is reported, dividing variable data and event monitoring data which are stored in association with the same association code into a group of grouped data;
and at least assembling the equipment code of the equipment, the timestamp reported by the equipment information and at least one group of grouped data according to a preset JSON format, and compressing the assembled data.
Further, the monitoring data uploading device calls the monitoring data uploading program stored in the memory 1005 through the processor 1001 to perform the following operations:
when the application program is started, judging whether the network type of the equipment where the current application program is positioned is a mobile communication network;
and if the network type of the current equipment is a mobile communication network, reporting equipment information of the equipment to a background server once and locally storing the equipment information.
Referring to fig. 2, fig. 2 is a functional module schematic diagram of an embodiment of a monitoring data uploading system according to the present invention.
In this embodiment, the monitoring data uploading system includes: background server 10, monitoring data upload equipment 20. An application APP client is installed in the monitoring data uploading device 20, and the monitoring data uploading device 20 can establish a wireless connection with the background server 10 through the APP client.
In this embodiment, in the process of uploading the monitoring data, the monitoring data uploading device 20 uploads the device information of itself and a monitoring data packet to the background server 10, where the monitoring data packet is a compressed packet and specifically includes volatile data of the monitoring data uploading device 20 and various event monitoring data collected during the running process of the application program.
In this embodiment, the monitoring data uploading device 20 independently reports the information of the device unchanged, and the APP is only required to be reported once when starting. The device information includes a device ID, and the monitoring data reported later can be associated with the uploaded device information through the device ID. In addition, the monitoring data uploading device 20 also reports data which is easy to change, such as network type and IP address, and these data are not changed in a period of time, so an association code is designed to group the monitoring data, and the event monitoring data with the same association code uses the same variable data. When the data is uploaded, the same group of monitoring data shares one part of volatile data, so that repeated volatile data uploading can be reduced, the flow consumption of the reporting terminal equipment is reduced, the flow overhead cost is saved for a user, and the performance influence on the reporting terminal equipment during the data uploading can be reduced.
Based on the hardware structure, the invention provides various embodiments of the monitoring data uploading method.
Referring to fig. 3, fig. 3 is a flowchart illustrating a monitoring data uploading method according to an embodiment of the present invention. The method and the device are particularly used for monitoring the performance of the application program in the running process.
In this embodiment, the monitoring data uploading method includes the following steps:
step S10, when the application program is started, reporting the device information of the device where the application program is located to the background server and storing the device information;
generally, when monitoring data is reported, each piece of data is required to be independent and complete, that is, each piece of data contains contents such as equipment information, network state, event monitoring data and the like, and some pieces of data are not changed permanently or in a short time, that is, each piece of uploaded monitoring data has repeatedly uploaded data, so that the flow consumption of a user terminal can be reduced by reducing the reporting of the repeated data.
Therefore, the embodiment preferably divides the monitoring data reported to the background into two parts:
optionally, the first part is data that does not change, that is, device information, and at least includes:
(1) the device code of the device in which the application is located, such as an IMEI (International Mobile equipment identity), is a unique identification number of the Mobile phone.
(2) The application program identification codes APP ID are used for distinguishing different models or versions of the same APP. Such as english version, chinese version, V1 version, V2 version, etc.
(3) The timestamp for reporting the device information, that is, the time point for reporting the device information to the background server.
Optionally, the second part is changed data, that is, variable data, and at least includes:
(1) a network type, such as a 2G/3G/4G mobile communication network, or a WI-FI network;
(2) the IP address is specifically the IP address of the equipment where the application program is located;
(3) a device system language, specifically, a language used by an operating system of a device in which an application program is located, such as chinese, english, and the like;
(4) the device system time zone is specifically a time zone set by an operating system of the device in which the application program is located, such as the beijing time GTM + 08.
The four types of variable data can not change in a short time, so that the reporting frequency of the data can be reduced, and the flow consumption is reduced.
(5) The event monitoring data corresponds to different event monitoring data due to different monitoring targets, and therefore, the content of each event monitoring data is different.
In this embodiment, different portions of data are separately reported, and for a first portion of data, reporting is performed once when the APP is started, and for a second portion of data, packet reporting is performed, and data that is not changed for a short time, such as a network type, an IP address, a system voice, a system time zone, and multiple event monitoring data that are obtained within the short time are reported as the same packet data, and the reporting time is not limited, such as reporting when any variable data changes.
In this embodiment, when the application program is started, the monitoring data uploading device 20 reports the device information of the device where the application program is located to the background server 10 once, and saves the reported device information backup to the local.
Step S20, judging whether the current variable data of the equipment changes or not in the running process of the application program;
in this step, in the running process of the application program, the monitoring data uploading device 20 monitors whether the volatile data of the device changes, and if the current monitoring result is different from the last monitoring result, it is determined that the volatile data of the current device changes. The volatile data includes multiple types of data, and if at least one type of data changes, the volatile data is indicated to have changed.
Step S30, if yes, a new association code is generated and stored in association with the changed volatile data;
when the volatile data changes, for example, the network type is changed from the 3G network to the 4G network, and the IP address changes, the monitoring data uploading device 20 regenerates a new association code.
Optionally, the monitoring data uploading device 20 may generate a new association code through a preset association code generator, and when the volatile data is stored, associate and store the new association code with the currently changed volatile data.
In this embodiment, the association code is specifically configured to associate the volatile data with the event monitoring data, so as to facilitate data grouping, thereby reducing the frequency and the number of times of repeatedly uploading the volatile data.
When a new association code is generated, the monitoring data uploading device 20 associates and stores the newly generated association code with the changed volatile data.
It should be noted that, in this embodiment, preferably, when the application program is started, each piece of volatile data is initialized to a null value, and after each piece of volatile data is assigned, that is, when the piece of volatile data changes, an association code is generated and is associated with the original piece of volatile data for storage.
Step S40, when the variable data is not changed, storing all the event monitoring data to be reported in the period in association with the current latest association code;
in this embodiment, during a period in which the volatile data is not changed, that is, during the period, all the event monitoring data to be reported correspond to the same volatile data, therefore, the monitoring data uploading device 20 stores all the event monitoring data to be reported in the period in association with the current latest association code, so that a one-to-many association relationship between the volatile data and the event monitoring data can be realized, and further, the grouped reporting of the monitoring data can be realized.
And step S50, when data are reported, the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same related code are assembled and compressed according to a preset format to obtain a monitoring data packet and are uploaded to a background server.
In this embodiment, when data is reported, the monitoring data uploading device 20 assembles the related information in the device information stored in step S10, the volatile data and the event monitoring data stored in association with the same association code according to a preset format, and at the same time, further compresses the data after the assembly is completed to obtain a monitoring data compression packet, and finally uploads the monitoring data compression packet to the background server 10.
The present embodiment is not limited to the manner of assembly. As will be clear to those skilled in the art, the uploaded event monitoring data corresponds to the same piece of volatile data, and the volatile data corresponds to the same piece of equipment information, so that it is preferable to assemble the equipment information, the volatile data, and the event monitoring data in an incomplete data reporting format, thereby reducing the uploading of duplicate data.
Optionally, because the monitoring data uploading device 20 is assembled in an incomplete data reporting format, in order to facilitate the background server 20 to obtain the monitoring data in the complete data reporting format, that is, to facilitate the background server 20 to perform secondary assembly of the complete data reporting format on the received data, the related information in the device information preferably includes: the device code and the timestamp reported by the device information, based on the relevant information, the background server 20 can determine the device information corresponding to the incomplete monitoring data before the secondary assembly.
In this embodiment, the execution sequence among the steps S20, S40, and S50 is not limited, and the monitoring data uploading device 20 preferably executes the steps concurrently.
In this embodiment, the data reported to the background is divided into two parts: the first part is unchanged data, including equipment information; the second part is changed data, including: short time invariant data such as network type, IP address, etc., and real time changing event monitoring data. In the APP operation process, the data of different parts are reported separately, for the first part of data, the data is reported once when the APP is started, and for the second part of data, packet reporting is adopted, short-time unchangeable data and a plurality of event monitoring data acquired in the short time are reported as the same packet data, and then the reporting of the same repeated data can be greatly reduced, so that the flow consumption of reporting end equipment is reduced, the flow overhead cost is saved for a user, and the performance influence on the reporting end equipment during data uploading can be reduced.
Further, in another embodiment of the monitoring data uploading method of the present invention, the step S50 includes:
step S501, when data are reported, dividing the variable data and the event monitoring data which are stored in association with the same association code into a group of grouped data;
the invention designs an association code to group the event monitoring data, and the event monitoring data with the same association code uses the same variable data. When data is uploaded, the event monitoring data of the same group shares one part of volatile data, so that repeated uploading of multiple parts of volatile data can be reduced, flow consumption of reporting end equipment is reduced, and flow overhead cost is saved for a user, such as a grouping division mode shown in table 1.
TABLE 1
| Group name | Volatile data | Association code | Event monitoring data |
| Group1 | 4G、192.168.1.10 | TrackId1 | Data A, B, C |
| Group2 | WiFi、192.168.1.1 | TrackId2 | Data E, F, G |
Step S502, at least assembling the equipment code of the equipment, the timestamp reported by the equipment information and at least one group of grouped data according to a preset JSON format, and compressing the assembled data to obtain a monitoring data packet;
step S503, uploading the monitoring data packet to the background server.
JSON (JSON Object Notation) is a lightweight data exchange format that stores and represents data in a text format that is completely independent of the programming language. The compact and clear hierarchical structure makes JSON an ideal data exchange language, easy for machine parsing and secondary assembly to generate new format data.
In this embodiment, the monitoring data uploading device 20 at least assembles the device code of the device, the timestamp for reporting the device information, and at least one group of the packet data according to a preset JSON format, for example, an assembly content shown in table 2.
TABLE 2
For example, the monitoring data uploading device 20 assembles all the data in the table 2 according to a preset JSON format, so as to obtain JSON format text data instead of the existing complete data reporting format.
Finally, the monitoring data uploading device 20 compresses one or more parts of the assembled content to obtain a compressed packet of the monitoring data and uploads the compressed packet to the background server 10 for analysis and then secondary assembly to finally obtain the same complete monitoring data in the data reporting format as the prior art.
Further, in another embodiment of the monitoring data uploading method of the present invention, the step S10 may further include:
step S101, when the application program is started, judging whether the network type of the equipment where the current application program is positioned is a mobile communication network;
step S102, if the network type of the current equipment is a mobile communication network, reporting equipment information of the equipment to a background server once, locally storing the equipment information and executing steps S20-S50;
and step S103, if the network type of the current equipment is a WIFI network, uploading data by adopting the existing monitoring data reporting mode.
In this embodiment, from the viewpoint of saving traffic and further reducing the use cost of the user, when the network used by the device where the application program is located is a mobile communication network, since the network is a charging network, the monitoring data uploading device 20 selectively uploads the monitoring data by using the data folding compression uploading scheme of the present invention, and if the network used by the device where the application program is located is a WIFI network, since the network is a free network, the monitoring data uploading device 20 may select to upload the monitoring data by using the data folding compression uploading scheme of the present invention, or may select to upload the data by using an existing monitoring data reporting method.
Referring to fig. 4, fig. 4 is a functional module schematic diagram of an embodiment of a monitoring data uploading apparatus of the present invention.
In this embodiment, the monitoring data uploading apparatus is applied to performance monitoring of an application program, and includes:
the first reporting module 10 is configured to report and store device information of a device in which the application program is located to a background server when the application program is started;
the judging module 20 is configured to judge whether the current volatile data of the device changes in the running process of the application program;
the first association module 30 is configured to generate a new association code and store the new association code in association with changed volatile data when the volatile data of the current device changes;
the second association module 40 is configured to, during a period in which the volatile data does not change, associate and store all event monitoring data to be reported and the current latest association code during the period;
and a second reporting module 50, configured to, during data reporting, assemble and compress the stored related information in the device information, the volatile data and the event monitoring data, which are stored in association with the same association code, according to a preset format, to obtain a monitoring data packet, and upload the monitoring data packet to the background server.
In this embodiment, the monitoring data uploading apparatus reports the information of the unchanged device independently, and the APP is only required to be reported once when starting. The device information includes a device ID, and the monitoring data reported later can be associated with the uploaded device information through the device ID. In addition, the monitoring data uploading device also reports data which are easy to change, such as network types and IP addresses, and the data are not changed in a period of time, so that an association code is designed to group the monitoring data, and the same variable data is used for the event monitoring data with the same association code. When the data is uploaded, the same group of monitoring data shares one part of volatile data, so that repeated volatile data uploading can be reduced, the flow consumption of the reporting terminal equipment is reduced, the flow overhead cost is saved for a user, and the performance influence on the reporting terminal equipment during the data uploading can be reduced.
Further optionally, in an embodiment of the monitoring data uploading system of the present invention, after receiving the monitoring data packet uploaded by the monitoring data uploading device 20, the background server 10 executes the following processing steps:
step S1, decompressing the monitoring data packet to obtain volatile data, event monitoring data and relevant information in the equipment information;
step S2, based on the relevant information, querying the device information received by the background server to obtain device information corresponding to the volatile data and the event monitoring data;
and step S3, assembling the obtained equipment information, the variable data and the event monitoring data to obtain a plurality of complete monitoring data and storing the monitoring data in a database of the background server.
Generally, data for application performance analysis must be complete, and a piece of complete monitoring data includes device information (such as device code, timestamp), network information (such as network type, IP address), and event monitoring data. Obviously, the data uploaded by the monitoring data uploading device 20 cannot be directly used for performance analysis, so that the background server 10 needs to further perform secondary assembly on the data in the monitoring data packet, specifically, expand the event monitoring data in each piece of the uploaded assembly data, and respectively supplement the corresponding device information, network type, IP address and other contents, thereby forming a complete piece of monitoring data, and finally store the complete piece of monitoring data in the database of the background server 10.
When the monitoring data uploading device 20 uploads the device information, the device information is also stored. After receiving the device information, the background server 10 stores the device information in the device information table. Each device (such as a mobile phone) has a non-repeating device code devId and an uploaded timestamp.
The monitoring data upload device 20 also has devId and timemap on it when assembling the data and compressing the upload. The background server 10 decompresses the compressed data after receiving the compressed data, finds out the corresponding device information in the device table through devId and timestamp, expands group packet data, supplements and perfects each piece of event monitoring data in the event monitoring data packet in format by using the inquired device information and the decompressed volatile data (such as network type, IP address and the like), and then stores the event monitoring data in a database.
In this embodiment, the data received by the background server 10 is not complete monitoring data, but complete monitoring data is obtained through secondary assembly, so that the requirement of the background server 10 on performance analysis of the application program is met, and meanwhile, the data uploading flow of the monitoring data uploading device 20 is reduced, thereby saving the cost of using the application by the user.
The invention also provides a computer readable storage medium applied to the monitoring data uploading equipment.
The computer-readable storage medium stores a monitoring data uploading program, and the monitoring data uploading program, when executed by the processor, implements the steps of any of the embodiments of the monitoring data uploading method.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The present invention is described in connection with the accompanying drawings, but the present invention is not limited to the above embodiments, which are only illustrative and not restrictive, and those skilled in the art can make various changes without departing from the spirit and scope of the invention as defined by the appended claims, and all changes that come within the meaning and range of equivalency of the specification and drawings that are obvious from the description and the attached claims are intended to be embraced therein.
Claims (10)
1. A monitoring data uploading method is applied to performance monitoring of an application program and is characterized by comprising the following steps:
when the application program is started, reporting equipment information of equipment where the application program is located to a background server for one time and storing the equipment information;
in the running process of an application program, judging whether the current volatile data of the equipment change, wherein the volatile data are data which are easy to change but are unchanged within a period of time, and the volatile data at least comprise: network type, IP address, device system language, device system time zone;
if yes, generating a new association code and storing the new association code in association with the changed volatile data;
during the period that the variable data is not changed, all event monitoring data to be reported in the period are stored in a correlation mode with the current latest correlation code;
and when the data is reported, assembling and compressing the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code according to a preset format to obtain a monitoring data packet and uploading the monitoring data packet to the background server.
2. The monitoring data uploading method according to claim 1, wherein the related information at least includes: the device code of the device and the timestamp reported by the device information.
3. The monitored data uploading method according to claim 1, wherein the generating a new association code and storing the new association code in association with the changed volatile data comprises:
and generating a new association code through a preset association code generator, and associating and storing the new association code with the changed volatile data when the volatile data is stored.
4. The monitoring data uploading method according to claim 3, wherein the assembling and compressing the related information in the stored device information, the volatile data stored in association with the same association code, and the event monitoring data according to a preset format during data uploading includes:
when data is reported, dividing variable data and event monitoring data which are stored in association with the same association code into a group of grouped data;
and at least assembling the equipment code of the equipment, the timestamp reported by the equipment information and at least one group of grouped data according to a preset JSON format, and compressing the assembled data.
5. The monitoring data uploading method according to claim 1, wherein reporting and storing device information of a device where the application program is located to the background server once when the application program is started comprises:
when the application program is started, judging whether the network type of the equipment where the current application program is positioned is a mobile communication network;
and if the network type of the current equipment is a mobile communication network, reporting equipment information of the equipment to a background server once and locally storing the equipment information.
6. A monitoring data uploading device is applied to performance monitoring of an application program, and is characterized by comprising:
the first reporting module is used for reporting the equipment information of the equipment where the application program is located to a background server and storing the equipment information when the application program is started;
the judging module is used for judging whether the current volatile data of the equipment change in the running process of the application program, wherein the volatile data are data which are easy to change but not change within a period of time, and the volatile data at least comprise: network type, IP address, device system language, device system time zone;
the first association module is used for generating a new association code and storing the new association code in association with the changed volatile data when the volatile data of the current equipment changes;
the second correlation module is used for correlating and storing all event monitoring data to be reported and the current latest correlation code in the period when the volatile data are not changed;
and the second reporting module is used for assembling and compressing the related information in the stored equipment information, the volatile data and the event monitoring data which are stored in association with the same association code according to a preset format when the data are reported to obtain a monitoring data packet and uploading the monitoring data packet to the background server.
7. A monitoring data uploading apparatus, comprising: a memory, a processor and a monitoring data upload program stored on the memory and executable on the processor, the monitoring data upload program when executed by the processor implementing the steps of the monitoring data upload method according to any of claims 1 to 5.
8. A monitoring data uploading system, wherein the monitoring data uploading system comprises a background server and the monitoring data uploading device of claim 7;
the background server is wirelessly connected with the monitoring data uploading device and used for receiving the device information uploaded by the monitoring data uploading device and the monitoring data packet.
9. The monitored data upload system of claim 8, wherein the backend server is further to:
decompressing the monitoring data packet to obtain volatile data, event monitoring data and related information in the equipment information;
inquiring the equipment information received by the background server based on the relevant information to obtain the equipment information corresponding to the variable data and the event monitoring data;
and assembling the obtained equipment information, the variable data and the event monitoring data to obtain a plurality of complete monitoring data and storing the complete monitoring data in a database of the background server.
10. A computer-readable storage medium, having a monitoring data uploading program stored thereon, which when executed by a processor implements the steps of the monitoring data uploading method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711233076.9A CN108023788B (en) | 2017-11-29 | 2017-11-29 | Monitoring data uploading method, device, equipment, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711233076.9A CN108023788B (en) | 2017-11-29 | 2017-11-29 | Monitoring data uploading method, device, equipment, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108023788A CN108023788A (en) | 2018-05-11 |
| CN108023788B true CN108023788B (en) | 2020-04-10 |
Family
ID=62077557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711233076.9A Active CN108023788B (en) | 2017-11-29 | 2017-11-29 | Monitoring data uploading method, device, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108023788B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109032884B (en) * | 2018-06-11 | 2021-05-28 | 平安科技（深圳）有限公司 | Monitoring data processing method, server and computer readable storage medium |
| CN111376255B (en) * | 2018-12-29 | 2022-06-24 | 深圳市优必选科技有限公司 | Robot data acquisition method and device and terminal equipment |
| CN110222084B (en) * | 2019-05-06 | 2021-10-22 | 奇安信科技集团股份有限公司 | Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal |
| CN111262875B (en) * | 2020-01-21 | 2021-06-18 | 腾讯科技（深圳）有限公司 | Server safety monitoring method, device, system and storage medium |
| CN112333233B (en) * | 2020-09-23 | 2023-11-24 | 北京达佳互联信息技术有限公司 | Event information reporting method and device, electronic equipment and storage medium |
| CN112235378B (en) * | 2020-09-29 | 2022-12-16 | 北京三快在线科技有限公司 | Data updating method and device, storage medium and electronic equipment |
| CN112463793B (en) * | 2020-11-24 | 2022-07-26 | 傲普(上海)新能源有限公司 | EMS information display system and method based on inflixdb database |
| CN113014456A (en) * | 2021-03-17 | 2021-06-22 | 北京奇艺世纪科技有限公司 | Monitoring data transmission system, method, device, equipment and storage medium |
| CN114968413A (en) * | 2022-06-21 | 2022-08-30 | 四三九九网络股份有限公司 | Method for collecting Android application starting event |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937930A (en) * | 2012-09-29 | 2013-02-20 | 重庆新媒农信科技有限公司 | Application program monitoring system and method |
| CN105260285A (en) * | 2015-10-21 | 2016-01-20 | 深圳市共济科技有限公司 | Method and system for data center to collect and upload data |
| CN106301972A (en) * | 2016-11-16 | 2017-01-04 | 北京集奥聚合科技有限公司 | A kind of monitoring data push away method and system in real time |
| US9594477B1 (en) * | 2014-02-06 | 2017-03-14 | Symantec Corporation | Using deep links to restore interactive state of a web page |
-
2017
- 2017-11-29 CN CN201711233076.9A patent/CN108023788B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937930A (en) * | 2012-09-29 | 2013-02-20 | 重庆新媒农信科技有限公司 | Application program monitoring system and method |
| US9594477B1 (en) * | 2014-02-06 | 2017-03-14 | Symantec Corporation | Using deep links to restore interactive state of a web page |
| CN105260285A (en) * | 2015-10-21 | 2016-01-20 | 深圳市共济科技有限公司 | Method and system for data center to collect and upload data |
| CN106301972A (en) * | 2016-11-16 | 2017-01-04 | 北京集奥聚合科技有限公司 | A kind of monitoring data push away method and system in real time |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108023788A (en) | 2018-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108023788B (en) | Monitoring data uploading method, device, equipment, system and storage medium | |
| CN110502546B (en) | Data processing method and device | |
| CN109672888B (en) | Picture compression method, equipment and computer readable storage medium | |
| CN103312544B (en) | A kind of control terminal reports the method, apparatus and system of journal file | |
| US20120117425A1 (en) | Method and apparatus for obtaining feedback from a device for recommendations | |
| CN111143163B (en) | Data monitoring method, device, computer equipment and storage medium | |
| CN111580884A (en) | Configuration updating method and device, server and electronic equipment | |
| CN107506284B (en) | Log processing method and device | |
| CN108337127B (en) | Application performance monitoring method, system, terminal and computer readable storage medium | |
| CN108197091B (en) | Method, system and related equipment for creating data table | |
| CN111209309A (en) | Method, device and equipment for determining processing result of data flow graph and storage medium | |
| CN111061678B (en) | Service data processing method, device, computer equipment and storage medium | |
| CN111045893B (en) | Method, device and system for executing monitoring task, storage medium and electronic device | |
| CN107168765A (en) | A kind of method and system of remote compilation software | |
| CN111104324A (en) | Test case generation method, test case generation device and computer-readable storage medium | |
| CN111552712A (en) | Report data extraction method and device and computer equipment | |
| CN107784085B (en) | Data list exporting method and terminal thereof | |
| CN104902432A (en) | Method and device for generating application operation log of terminal mobile | |
| CN115208951A (en) | Request processing method and device, electronic equipment and computer readable storage medium | |
| CN107769947B (en) | Method, device and equipment for replacing customized skin | |
| CN110166823B (en) | Screen projection method and related device | |
| US8700954B2 (en) | Common trouble case data generating method and non-transitory computer-readable medium storing common trouble case data generating program | |
| CN111339170A (en) | Data processing method and device, computer equipment and storage medium | |
| CN104483880A (en) | Data acquisition method and data acquisition server | |
| CN111355767B (en) | Remote control method, server, client and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |