CN111835700B - Data processing method and device, electronic equipment and storage medium - Google Patents

Data processing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111835700B
CN111835700B CN201911229011.6A CN201911229011A CN111835700B CN 111835700 B CN111835700 B CN 111835700B CN 201911229011 A CN201911229011 A CN 201911229011A CN 111835700 B CN111835700 B CN 111835700B
Authority
CN
China
Prior art keywords
state data
data
target
compression
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911229011.6A
Other languages
Chinese (zh)
Other versions
CN111835700A (en
Inventor
李新虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Didi Infinity Technology and Development Co Ltd
Original Assignee
Beijing Didi Infinity Technology and Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Didi Infinity Technology and Development Co Ltd filed Critical Beijing Didi Infinity Technology and Development Co Ltd
Priority to CN201911229011.6A priority Critical patent/CN111835700B/en
Publication of CN111835700A publication Critical patent/CN111835700A/en
Application granted granted Critical
Publication of CN111835700B publication Critical patent/CN111835700B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mathematical Physics (AREA)
  • Computer Hardware Design (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application provides a data processing method, a data processing device, an electronic device and a storage medium, wherein the data processing method comprises the following steps: acquiring state data generated by a target application program in the running process, wherein the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event; performing data compression on the acquired state data according to a target compression mode to obtain compressed state data; sending the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compression state data based on the determined decompression mode so as to determine the running state of the target monitoring event. The method and the device reduce the occupancy rate of the data transmission channel, thereby reducing the consumption of channel resources.

Description

Data processing method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.
Background
With the rapid development of the internet and computers, clients using Application programs (APPs) are becoming more and more popular, such as APP clients and portable smart devices, and various types of software and Application services installed on conventional computers.
Before general APP comes into the market or after upgrading, the running state of the application program needs to be monitored, the APP is convenient to be corrected in time, when an enterprise monitors the APP on the mobile terminal, a mode of embedding points in the APP is often adopted to obtain running data generated when the APP runs, some data in the running data are approximate continuous data and can also be called as state data, for example, the running state of monitoring events of monitoring vehicle mileage data needs to be fed back to a background server in time, so that the background server is used for determining the running condition of some important functions in the APP, and therefore the background server can take corresponding improvement or correction schemes in time when determining that the APP breaks down.
At present, the state data are generally directly sent to the background server according to a short time interval, and the problems of high occupancy rate of a data transmission channel and high resource consumption rate exist in the data transmission process.
Disclosure of Invention
In view of this, an object of the present application is to provide a data processing method, an apparatus, an electronic device, and a storage medium, which reduce an occupancy rate of a data transmission channel, thereby reducing consumption of channel resources.
In a first aspect, an embodiment of the present application provides a data processing method, which is applied to a terminal device, where the data processing method includes:
acquiring state data generated by a target application program in the running process, wherein the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event;
performing data compression on the acquired state data according to a target compression mode to obtain compressed state data;
sending the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compression state data based on the determined decompression mode so as to determine the running state of the target monitoring event.
In some embodiments, the target application is a travel application and the target monitoring events include monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
In some embodiments, the target monitoring event includes a plurality of target monitoring events, the target compression mode is a secondary compression mode including a first data compression mode and a second data compression mode, and the performing data compression on the acquired state data according to the target compression mode to obtain compressed state data includes:
performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on intermediate compression state data corresponding to the target monitoring events to obtain final compressed compression state data; and the second data compression is packing compression.
In some embodiments, the state data includes an attribute tag, and for at least one piece of bar-state data corresponding to each target monitoring event, performing first data compression on the at least one piece of bar-state data to obtain intermediate compressed state data corresponding to the target monitoring event, the method includes:
for each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label to shorten the byte length occupied by the state data; and/or the presence of a gas in the gas,
deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
In some embodiments, before performing the second data compression on the intermediate compression state data corresponding to the multiple target monitoring events, the method further includes:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
and if so, encrypting the user information.
In a second aspect, an embodiment of the present application provides a data processing method, which is applied to a background server, where the data processing method includes:
after receiving the compressed state data and the target compression mode uploaded by the terminal equipment, decompressing the compressed state data according to a decompression mode corresponding to the target compression mode to obtain state data of each target monitoring event started by a target application program; the state data comprises a timestamp and a state code generated by the state data;
and determining whether the running state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and a set time threshold.
In some embodiments, the target compression manner includes a first data compression and a second data compression, and the decompressing the compression state data in a decompression manner corresponding to the target compression manner includes:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
In some embodiments, before the decompressing, according to a first decompression manner corresponding to the first data compression of the target monitoring event, the intermediate compressed state data corresponding to each target monitoring event to obtain decompressed state data corresponding to each target monitoring event, the data processing method further includes:
judging whether the intermediate compression state data contains encrypted user information or not;
and if so, determining an encryption algorithm corresponding to the user information based on the target compression mode, and decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
In some embodiments, the decompressing step of decompressing, for the intermediate compressed state data corresponding to each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event according to a first decompressing manner corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event includes:
for each identification character contained in the intermediate compression state data, replacing the identification character according to the attribute tag corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute tag in the intermediate compression state data; and/or the presence of a gas in the gas,
adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
In one embodiment, the determining, based on the timestamp, the type of the status code, and the set number threshold corresponding to the status data of each target monitoring event, whether an operating status corresponding to the status code of the target type exists after the target monitoring event is triggered includes:
determining at least one continuous time corresponding to the state code of the target type based on the timestamp and the state code contained in each piece of state data;
judging whether the maximum value of the at least one continuous times reaches the set time threshold value;
and when the maximum value of the at least one continuous time is determined to reach the set time threshold, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered.
In some embodiments, the determining, based on the timestamp and the status code included in each piece of status data, at least one consecutive number of times corresponding to the status code of the target type includes:
sequencing the plurality of pieces of state data according to the timestamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding sequence number of each piece of state data in the first sequence;
updating the serial numbers of the state data containing the same state code in the first sequence according to the timestamp corresponding to the state data to obtain a second sequence containing the updated state data of the corresponding serial numbers and the corresponding serial number of each state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed from the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the difference value of the same serial number corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
In a third aspect, an embodiment of the present application provides a data processing apparatus residing in a terminal device, where the data processing apparatus includes:
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring state data generated by a target application program in the running process, and the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event;
the compression module is used for carrying out data compression on the obtained state data according to a target compression mode to obtain compressed state data;
the sending module is used for sending the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compression state data based on the determined decompression mode so as to determine the running state of the target monitoring event.
In some embodiments, the target application is a travel application and the target monitoring events include monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
In some embodiments, the target monitoring event includes a plurality of target monitoring events, the target compression mode is a secondary compression mode including a first data compression mode and a second data compression mode, and the compression module, when being configured to perform data compression on the obtained state data according to the target compression mode to obtain compressed state data, includes:
performing first data compression on at least one strip-shaped data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on intermediate compression state data corresponding to a plurality of target monitoring events to obtain finally compressed compression state data; and the second data is compressed into a packing compression.
In some embodiments, the state data includes an attribute tag, and the compression module, when being configured to perform first data compression on at least one piece of bar-state data corresponding to each target monitoring event to obtain intermediate compressed state data corresponding to the target monitoring event, includes:
for each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label to shorten the byte length occupied by the state data; and/or the presence of a gas in the atmosphere,
and deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
In some embodiments, the compression module, before performing the second data compression on the intermediate compression state data corresponding to the plurality of target monitoring events, is further configured to:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
and if so, encrypting the user information.
In a fourth aspect, an embodiment of the present application provides a data processing apparatus, which resides in a backend server, where the data processing apparatus includes:
the decompression module is used for decompressing the compressed state data according to a decompression mode corresponding to the target compression mode after receiving the compressed state data and the target compression mode uploaded by the terminal equipment to obtain state data of each target monitoring event started by the target application program; the state data comprises a timestamp and a state code generated by the state data;
and the determining module is used for determining whether the running state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and a set time threshold.
In some embodiments, the target compression manner includes a first data compression and a second data compression, and the decompression module, when configured to decompress the compression state data in a decompression manner corresponding to the target compression manner, includes:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
In some embodiments, before decompressing, by the decompression module, the intermediate compressed state data corresponding to each target monitoring event according to a first decompression manner corresponding to the first data compression of the target monitoring event, and obtaining decompressed state data corresponding to each target monitoring event, the decompression module is further configured to:
judging whether the intermediate compression state data contains encrypted user information or not;
if yes, determining an encryption algorithm corresponding to the user information based on the target compression mode, and then decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
In some embodiments, the intermediate compression state data includes a plurality of identification characters, and the decompressing module, when configured to decompress, for the intermediate compression state data corresponding to each target monitoring event, the intermediate compression state data corresponding to the target monitoring event according to a first decompressing manner corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event, includes:
aiming at each identification character contained in the intermediate compression state data, replacing the identification character according to an attribute label corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute label in the intermediate compression state data; and/or the presence of a gas in the gas,
and adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
In one embodiment, the status data includes a plurality of pieces, and the determining module, when configured to determine whether an operating status corresponding to a status code of a target type exists after the target monitoring event is triggered based on the timestamp, the type of the status code, and a set threshold of times corresponding to the status data of each target monitoring event, includes:
determining at least one continuous time corresponding to the state code of the target type based on the timestamp and the state code contained in each piece of state data;
judging whether the maximum value of the at least one continuous frequency reaches the set frequency threshold value;
and when the maximum value of the at least one continuous time is determined to reach the set time threshold, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered.
In some embodiments, the status data includes a plurality of pieces, and the determining module, when configured to determine at least one consecutive number of times that the status code of the target type corresponds to based on the timestamp and the status code included in each piece of status data, includes:
sequencing the plurality of pieces of state data according to the timestamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding sequence number of each piece of state data in the first sequence;
updating the serial numbers of the state data containing the same state code in the first sequence according to the timestamp corresponding to the state data to obtain a second sequence containing the state data with the updated corresponding serial numbers and the corresponding serial number of each piece of state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed with the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the same serial number difference value corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the data processing method according to the first or second aspect.
In a sixth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the data processing method according to the first aspect or the second aspect.
According to the data processing method provided by the embodiment of the application, after the state data generated by the target application program in the operation process is acquired, the acquired state data is subjected to data compression according to the target compression mode, and then the compressed state data and the target compression mode are sent to the background server, so that the background server decompresses the compressed state data based on the determined decompression mode, and then the operation state of the target monitoring event is determined.
The status data is data that needs to be received by the background server in time to determine the operation status of some important functions in the target application program, and therefore the status data needs to be sent to the background server in time, for example, sent to the background server at a short time interval.
Drawings
To more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a flowchart illustrating a data processing method provided in an embodiment of the present application;
FIG. 2 is a flow chart of another data processing method provided by the embodiment of the application;
fig. 3 is a flowchart illustrating a method for determining whether an operating state corresponding to a status code of a target type exists according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram illustrating a data processing apparatus according to an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating an alternative data processing apparatus according to an embodiment of the present application;
fig. 6 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 7 shows a schematic structural diagram of another electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.
In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
In order to enable those skilled in the art to use the present disclosure, the following embodiments are given in conjunction with a specific application scenario "data processing method in driving application". It will be apparent to those skilled in the art that the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the application. Although the present application is described primarily in the context of a data processing method in a driving application, it should be understood that this is merely one exemplary embodiment.
It should be noted that in the embodiments of the present application, the term "comprising" is used to indicate the presence of the features stated hereinafter, but does not exclude the addition of further features.
At present, before the application program comes into the market or after the application program is upgraded, the running state of the application program needs to be monitored, so that the application program can be corrected in time, and when an enterprise monitors the application program on a mobile terminal, the application program is often monitored in a point burying mode in the application program, so that running data generated during the running of the application program is acquired.
When monitoring an application program, some points are buried for monitoring approximate rate continuous data generated in the running process of the application program, the data may be referred to as state data, which indicates that the data needs to be fed back to a background server in time, so that the background server is used for determining the data of the running condition of some important functions in the target application program, the data needs to be fed back to the background server in time, and at present, the data is generally directly sent to the background server according to a short time interval, so that the occupancy rate of a data transmission channel is high, and the resource consumption rate is high.
As shown in fig. 1, a data processing method provided in an embodiment of the present application is applied to a terminal device, and the data processing method includes the following specific steps S101 to S103:
s101, state data generated in the running process of the target application program is obtained, and the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event.
The target application program refers to an application program that needs to be monitored by the background server, and during a development process or an upgrade process of the monitored target application program, a scheme of embedding points in the application program is often adopted to obtain data generated after the target application program is started.
The target Application may be a social Application (APP), some video playing APP, or some other type of APP.
The state data refers to preset specific types of data, and the specific types of data are approximate rate continuous data generated in the running process of the application program, and specifically may refer to data that needs to be continuously fed back to the background server in time so that the background server can determine the running condition of some important functions in the application program.
For example, taking a target application as a travel application as an example, that is, currently in the travel field, a service provider and a service requester may generally have a travel application loaded thereon, a service requester such as a passenger may initiate a travel order through the travel application on the service requester, and a service provider such as a driver may take over the travel order through the travel application on the service provider.
Specifically, during the running process of the vehicle, the trip application program can also monitor the vehicle running data, and the monitored vehicle running data, such as vehicle mileage data, vehicle speed data and vehicle travel price data, are sent to the background server, so that the background server can master the vehicle running condition in time, and before general travel application programs come into the market, or after the updating is needed, the travel application program is subjected to point burying to obtain state data generated by the travel application program when monitoring vehicle operation data, for example, a plurality of buried points are set in the travel application program, each buried point is a target monitoring event, the monitoring application program is used for monitoring state data generated after the function corresponding to the target monitoring event in the application program is started, for example, the target monitoring event comprises monitoring vehicle mileage data, monitoring vehicle running speed data and monitoring vehicle travel price data.
The trip application program is used for starting a target monitoring event for monitoring vehicle mileage data and then monitoring state data of vehicle mileage change; the method comprises the steps that a target monitoring event for monitoring vehicle running speed data is used for monitoring state data of vehicle running speed change after a trip application program is started; the target monitoring event for monitoring the vehicle trip price is used for monitoring the state data of the vehicle trip price change after the trip application program is started.
Specifically, after the travel application is started, if a certain target monitoring event is triggered, the target monitoring event generates corresponding running state information, and the running state information can represent a running state of the travel application corresponding to the target monitoring event in a running process, so that the running state information needs to be fed back to a background server in time, the background server can determine the performance of the travel application based on the running state information, and the travel application is improved in time when a problem occurs.
And S102, performing data compression on the acquired state data according to a target compression mode to obtain compressed state data.
Here, because the state data is continuous data and needs to be fed back to the background server in time, the state data obtained is generally sent to the background server at a set time interval, for example, the state data obtained is sent to the background server once every minute.
Further, if the target monitoring event includes a plurality of target monitoring events, and the target compression mode is a secondary compression mode including a first data compression mode and a second data compression mode, in step S102, performing data compression on the acquired state data according to the target compression mode to obtain compressed state data, including:
(1) performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
(2) performing second data compression on the intermediate compression state data corresponding to the target monitoring events to obtain final compressed compression state data; the second data compression is a packed compression.
Specifically, when performing the first data compression on the state data corresponding to each target monitoring event, the state data may be compressed according to the first data compression manner corresponding to the target monitoring event, where the first data compression manners may also be different because the events monitored by different target monitoring events are different.
For example, 3 target monitoring events are respectively recorded as a target monitoring event a, a target monitoring event B and a target monitoring event C, wherein each target monitoring event obtains 3 pieces of state data, and data compression is performed on the 3 pieces of state data corresponding to the target monitoring event a according to a first data compression mode corresponding to the target monitoring event a to obtain intermediate compression state data corresponding to the target monitoring event a; performing data compression on 3 pieces of state data corresponding to the target monitoring event B according to a first data compression mode corresponding to the target monitoring event B to obtain intermediate compression state data corresponding to the target monitoring event B; and performing data compression on the 3 pieces of state data corresponding to the target monitoring event C according to a first data compression mode corresponding to the target monitoring event C to obtain intermediate compression state data corresponding to the target monitoring event C.
Specifically, the state data includes an attribute tag, where the attribute tag includes a tag set in advance for a data format, content, and the like in the state data, and for example, the tag may include a naming method of the state data, a content name monitored by the state data, and the like, and then the above-mentioned at least one piece of bar-shaped data corresponding to each target monitoring event is subjected to first data compression to obtain intermediate compressed state data corresponding to the target monitoring event, including:
(1) aiming at each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label so as to shorten the byte length occupied by the state data; and/or the presence of a gas in the gas,
(2) and deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
Specifically, the first data compression here may include the (1) th data compression manner here, may also include the (2) th data compression manner here, or may include both the (1) th data compression manner and the (2) th data compression manner here.
For example, if the state data includes an attribute tag of "driving speed data of a vehicle", the attribute tag may be replaced by an identifier character "1234" corresponding to the attribute tag, so that a byte occupied by the "driving speed data of the vehicle" in the state data is changed into a byte occupied by the identifier character "1234", that is, the byte length occupied by the state data is shortened.
Or, taking the data compression method (2) as an example, the characters at the set positions in the status data corresponding to the target monitoring event may be deleted, where the characters at the set positions in the plurality of pieces of status data corresponding to the target monitoring event have the same meaning, for example, the characters at the set positions of the timestamps in the status data are deleted, for example, the characters at the set positions of the timestamps are deleted, for example, the timestamps "10: 44: 43" are 10:44:43 "in 8/26/2019, because the year, month and day of the timestamps included in the status data corresponding to the target monitoring event collected in the same time length are the same, the timestamps" 10:44:43 "may be obtained in a unified manner, and thus, the purpose of shortening the byte length occupied by the status data may also be achieved.
The above two modes can be implemented separately or together, and when implemented together, the order of implementation is not limited.
After the state data corresponding to each target monitoring event is subjected to the first data compression to obtain the intermediate compressed state data corresponding to the target monitoring event, further compression, such as packet compression, of the intermediate compressed state data corresponding to the target monitoring events may be considered, so that occupation of a channel is further reduced, and resource consumption is reduced.
For example, if the state data corresponding to the target monitoring event a is compressed to obtain 3 pieces of intermediate compressed state data, the state data corresponding to the target monitoring event B is compressed to obtain 3 pieces of intermediate compressed state data, and the state data corresponding to the target monitoring event C is compressed to obtain 3 pieces of intermediate compressed state data, there are 9 pieces of intermediate compressed state data in total, and at this time, the 9 pieces of intermediate compressed state data may be packed and compressed, for example, the 9 pieces of intermediate compressed state data may be packed and compressed according to the GZIP compression technology, and finally, the compressed state data is obtained.
In addition, in order to protect the user privacy data during the data transmission process, before performing the second data compression on the intermediate compression state data corresponding to the multiple target monitoring events, the method further includes:
(1) judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
(2) if so, encrypting the user information.
The user information may refer to user privacy data such as a user name, a user mobile phone number, a user identification number, a user account number and the like, and in order to prevent the problem that the user information is unsafe due to data leakage in the data transmission process, the user information may be encrypted before the second data compression is performed on the data in the intermediate compression state, and certainly, the user information may also be encrypted before the first data compression, which is not described herein again.
The Encryption process may be to encrypt the user information according to a set Encryption algorithm, and may be performed by, for example, a Data Encryption Standard (DES) algorithm, an Advanced Encryption Standard (AES) algorithm, or an RSA Encryption algorithm.
S103, sending the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compressed state data based on the determined decompression mode so as to determine the running state of the target monitoring event.
After the compressed state data is obtained, the compressed state data and a target compression mode can be sent to the background server, the target compression mode can be identification information representing the target compression mode, after the background server receives the identification information, a decompression mode corresponding to the target compression mode can be determined, then the compressed state data is decompressed based on the determined decompression mode so as to restore the state data obtained by the terminal device, and then the running state of a target monitoring event in the target application program is further determined based on the state data.
As shown in fig. 2, another data processing method provided in this embodiment of the present application is applied to a backend server, and the data processing method includes the following specific steps S201 to S202:
s201, after receiving the compressed state data and the target compression mode uploaded by the terminal equipment, decompressing the compressed state data according to a decompression mode corresponding to the target compression mode to obtain state data of each target monitoring event started by the target application program; the status data includes a timestamp and a status code generated by the status data.
When the target compression mode of the terminal device comprises the first data compression and the second data compression, decompressing the compressed state data according to a decompression mode corresponding to the target compression mode, wherein the decompressing comprises the following steps:
(1) decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
(2) and for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
The decompression process here corresponds to a compression process of the terminal device, specifically, the second decompression manner here corresponds to a second data compression process in the compression process, for example, when the second data compression process is based on the GZIP compression technology, the second decompression manner here is decompression based on the GZIP decompression technology, the first decompression manner corresponds to a first data compression process in the compression process, in the whole decompression process, firstly, the compression state data is decompressed according to the second decompression manner, that is, the intermediate compression state data corresponding to each target monitoring event can be obtained, and then, for the intermediate compression state data corresponding to each target monitoring event, the decompression is performed according to the first decompression manner corresponding to the target monitoring event.
For example, for compressed state data corresponding to 3 target monitoring events mentioned above in the compression process, that is, the target monitoring event a, the target monitoring event B, and the target monitoring event C at a certain time, first, 9 pieces of intermediate compressed state data are obtained for the compressed state data according to a second decompression manner, and are respectively 3 pieces of intermediate compressed state data corresponding to the target monitoring event a, 3 pieces of intermediate compressed state data corresponding to the target monitoring event B, and 3 pieces of intermediate compressed state data corresponding to the target monitoring event C, then, the intermediate compressed state data corresponding to the 3 target monitoring events are respectively decompressed according to a first decompression manner corresponding to the first data compression of the target monitoring event, and further, decompressed state data corresponding to each target monitoring event is obtained.
Specifically, before decompressing, for each intermediate compressed state data corresponding to each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event according to a first decompression manner corresponding to the first data compression of the target monitoring event, and obtaining decompressed state data corresponding to each target monitoring event, the data processing method further includes:
(1) judging whether the intermediate compression state data contains encrypted user information or not;
(2) and if so, determining an encryption algorithm corresponding to the user information based on the target compression mode, and decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
Before decompressing the intermediate compressed state data, it may be determined whether the intermediate compressed state data includes the encrypted user information, and if so, the encrypted user information needs to be decrypted, so as to subsequently determine the user identity corresponding to the target application program.
Here, the decryption algorithm corresponding to the user information may be determined through a target compression mode, for example, the target compression mode may include an encryption processing mode, for example, the target compression mode may include an encryption identifier representing the encryption processing mode, for example, the encryption identifiers corresponding to the DES algorithm, the AES algorithm, or the RSA encryption algorithm are D-1, a-1, and R-1, respectively, if the encryption identifier carried in the target compression mode is D-1, the encryption algorithm may be determined to be the DES algorithm, and the encrypted user information may be decrypted according to the decryption algorithm corresponding to the DES algorithm.
Certainly, the encryption algorithm and the decryption algorithm in the embodiment of the present application may also be set in advance, for example, the encryption identifier carried in the target compression mode represents a default encryption algorithm, and decryption may be performed according to a set decryption algorithm corresponding to the default encryption algorithm.
After decompressing the compressed state data according to the second decompression method, the obtained intermediate compressed state data corresponding to each target monitoring event may include a plurality of identification characters, and then decompressing, for the above-mentioned intermediate compressed state data corresponding to each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event according to the first decompression method corresponding to the first data compression of the target monitoring event, so as to obtain decompressed state data corresponding to each target monitoring event, including:
(1) aiming at each identification character contained in the intermediate compression state data, replacing the identification character according to the attribute label corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute label in the intermediate compression state data; and/or the presence of a gas in the gas,
(2) adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
After the intermediate compression state data corresponding to each target monitoring event is obtained, the intermediate compression state data corresponding to each target monitoring event may continue to be further decompressed according to the first decompression manner, where the first decompression manner may include the (1) th decompression manner herein, may also include the (2) th decompression manner herein, or includes both the (1) th decompression manner and the (2) th decompression manner herein.
Taking the decompression method of type (1) as an example, for an identifier character "1234" contained in some intermediate compressed state data, the identifier character "1234" is replaced according to an attribute tag "driving speed data of a vehicle" corresponding to the identifier character "1234", so that the byte length occupied by the character "1234" representing the attribute tag in the intermediate compressed state data is reduced to the byte length occupied by the attribute tag "driving speed data of the vehicle", that is, the byte length occupied by the character representing the attribute tag in the intermediate compressed state data is reduced.
Alternatively, taking the decompression method (2) as an example, adding a character corresponding to a set position in the intermediate compressed state data corresponding to the target monitoring event, which may be a character of a set position having a consistent meaning in the plurality of pieces of intermediate compressed state data corresponding to the target monitoring event, for example, adding a character of a set position indicating a time stamp in the intermediate compressed state data, for example, adding a time stamp "26/8/2019" 10/8/44: 43 "before the time stamp" 10:44:43 "to obtain a time stamp after recovery" 26/8/2019/26/10: 44:43 "may be performed in a unified manner, so as to recover the byte length occupied by the character at the set position.
The first decompression mode is specifically that the (1) th decompression mode or the (2) th decompression mode is independently adopted, or the (1) th decompression mode and the (2) th decompression mode are simultaneously adopted to relate to a target compression mode uploaded by the terminal device and received by the background server, if the terminal device performs first data compression on the state data, the (1) th data compression mode in the first data compression is adopted, the (1) th decompression mode is independently adopted to decompress the intermediate compression state data; if the terminal equipment adopts the (2) th data compression mode in the first data compression when performing the first data compression on the state data, the (2) th decompression mode is independently adopted to decompress the intermediate compression state data; if the terminal device performs the first data compression on the state data, and simultaneously adopts the (1) th data compression mode and the (2) th data compression mode in the first data compression, the (1) th decompression mode and the (2) th decompression mode are also simultaneously adopted to decompress the intermediate compression state data, and the sequence of the (1) th decompression mode and the (2) th decompression mode corresponds to the execution sequence of the (1) th data compression mode and the (2) th data compression mode in the first data compression process.
After the compressed state data is decompressed to obtain the state data of each target monitoring event, the operating state of the target application program can be further judged according to the state data including the timestamp and the state code generated by the state data.
The timestamp is the time when the state data corresponding to the target monitoring event is generated, because the state data is reported to the background server in batch, the time corresponding to each piece of state data may not be the same, and the occurrence sequence of the state data needs to be determined according to the timestamp.
The status code may be an identification code set in advance for representing a status of the target monitoring event when the target application is executing a point burying process, that is, when the target monitoring event is arranged, for example, the status code a represents that the status of the target monitoring event is normal, and the status code B represents that the status of the target monitoring event is abnormal.
S202, determining whether the running state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and the set time threshold.
Here, the type of the status code is determined in advance and stored in the background server, and for example, if the received status data includes the status code B, it may be determined that the type corresponding to the status code is an abnormal type according to the storage record.
The set number threshold may be obtained through a large amount of data statistics in an earlier stage, for example, if an identifier representing an abnormal event appears N times continuously, and N is greater than the set number threshold, it is determined that the abnormal event exists, and if the identifier representing the abnormal event only happens accidentally, it cannot be said that the abnormal event occurs.
Specifically, the status data includes a plurality of pieces, and in step S202, it is determined whether an operating status corresponding to a status code of a target type exists after the target monitoring event is triggered based on a timestamp corresponding to each target monitoring event, the type of the status code, and a set number threshold, including the flowchart shown in fig. 3, and the specific steps include the following steps S301 to S303:
s301, based on the timestamp and the status code contained in each piece of status data, determining at least one continuous time corresponding to the status code of the target type.
Here, the timestamp included in each piece of state data is the time when the state data is generated, where the number of consecutive times corresponding to the state code of the target type is determined, for example, after the server decompresses the compressed state data, 20 pieces of state data are obtained, and if the 20 pieces of state data are sorted according to the timestamp, it is found that 5 pieces of consecutive state data all include the state code B of the abnormal type, and the number of consecutive times corresponding to the state code B is 5.
Of course, if there are two consecutive pieces of status data in the 20 pieces of status data, including the status code B of the abnormal type, and then after an interval including other types of status codes, 5 consecutive pieces of status data are found, both including the status code B of the abnormal type, the consecutive times corresponding to the status code B are 2 times and 5 times, respectively.
S302, judging whether the maximum value of at least one continuous frequency reaches a set frequency threshold value.
In the embodiment of the present application, the consecutive times here is the highest consecutive times, for example, when the consecutive times corresponding to the status code B are 2 times and 5 times respectively, it is determined whether the consecutive times 5 exceeds a set number threshold.
And S303, when the maximum value of at least one continuous time reaches the set time threshold, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered.
Correspondingly, when the highest continuous times corresponding to the state codes of the determined target types reach the set times threshold value, the operating states corresponding to the state codes of the determined target types exist.
For example, a numerical labeling algorithm may be used, that is, after the terminal device generates each piece of state data, the state data is encoded, and after the server decompresses the obtained state data with codes, the server determines the continuous times corresponding to the state codes of the target type through the codes, but in this way, the number of the coded bits needs to be additionally increased on each piece of state data, in this embodiment of the present application, a way of determining the continuous times corresponding to the state codes of the target type based on a double pointer difference calculation method is provided, and specifically, in step S301, when at least one continuous time corresponding to the state codes of the target type is determined based on a timestamp and a state code included in each piece of state data, the method may be implemented through the following 4 steps:
(1) sequencing the plurality of pieces of state data according to the time stamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding serial number of each piece of state data in the first sequence;
(2) updating the serial numbers of the state data containing the same state code in the first sequence according to the time stamp corresponding to the state data to obtain a second sequence containing the state data with the updated corresponding serial numbers and the serial number corresponding to each state data in the second sequence;
(3) the sequence number corresponding to each piece of state data in the first sequence is differed with the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
(4) and taking the repetition times of the same serial number difference value corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
The following description is provided by referring to the following table 1, in which 10 pieces of status data corresponding to the target monitoring event a are combined to determine the number of consecutive times corresponding to the abnormal status code:
TABLE 1
Name of record Order id Status code Sequence I Sequence II Difference value
Record1 834211134212 A 1 1 0
Record2 834211134212 A 2 2 0
Record3 834211134212 B 3 1 2
Record4 834211134212 B 4 2 2
Record5 834211134212 A 5 3 2
Record6 834211134212 B 6 3 3
Record7 834211134212 B 7 4 3
Record8 834211134212 B 8 5 3
Record9 834211134212 B 9 6 3
Record10 834211134212 B 10 7 3
As shown in table 1 above, for a target monitoring event a, 10 pieces of state data corresponding to the target monitoring event a, that is, 10 pieces of state data Record 1-Record 10, are obtained after decompression, and then the 10 pieces of state data are sorted according to a time sequence according to a timestamp included in each piece of state data, so as to obtain a first sequence, where a sequence number of each piece of state data in the first sequence is gradually increased; then, the state data in the first sequence containing the same state code is updated according to the sequence number of the corresponding timestamp of the state data, for example, the state data in the first sequence containing the state code a is updated in sequence number by taking the state data as a unit, and the state data in the first sequence containing the state code B is updated in sequence number by taking the state data as a unit.
When the state data containing the state code A is updated, if the state data containing the state codes of other types is met, the state data is directly skipped, and similarly, when the state data containing the state code B is updated, if the state data containing the state codes of other types is met, the state data is also directly skipped, and the sequence number in the first sequence is updated according to the mode to obtain the second sequence.
Then, the sequence number corresponding to each piece of state data in the first sequence is subtracted from the sequence number corresponding to the piece of state data in the second sequence, so that a sequence number difference value corresponding to each piece of state data can be obtained, and further, the number of times of continuity of the type of state code can be determined by judging the number of times of repetition of the same sequence number difference value corresponding to the same type of state code, for example, as can be seen from table 1, 2 times of continuity of state data containing state code a occur, 2 times of continuity of state data containing state code B occur, and 5 times of continuity of state data containing state code B occur.
The number of consecutive times corresponding to the status code B is 2 and 5, respectively, and further, it may be determined whether the maximum value of 5 consecutive times included in the number of consecutive times corresponding to the status code B reaches a set threshold number, if yes, it is determined that the operating status corresponding to the status code B exists, otherwise, it is determined that the operating status corresponding to the status code B does not exist.
The double-pointer difference calculation method adopted by the embodiment of the application can be optimized in a statistical algorithm level, is superior to a common numerical marking algorithm, and has more advantages in resource occupation and flexibility calculation.
In addition, after the repetition times of the state data including each state code are counted by using the double-pointer difference value calculation method, distribution statistics may be performed on the repetition times corresponding to each state code, so as to perform subsequent state analysis on the target application program based on a distribution statistical result, which is not specifically described herein.
According to the data processing method provided by the embodiment of the application, after receiving the compressed state data and the target compression mode uploaded by the terminal device, the compressed state data can be decompressed according to the decompression mode corresponding to the target compression mode to obtain the state data of each target monitoring event started by the target application program, then whether the running state corresponding to the state code of the target type exists after the target monitoring event is triggered is further determined based on the fact that the state data corresponding to each target monitoring event comprises the timestamp and the state code generated by the state data, namely, the compressed state data uploaded by the terminal device can be restored, and the running state of the target application program is further determined, so that the state data is compressed through the mobile terminal, the background server further decompresses the state data, and therefore the occupancy rate of the data on a data transmission channel is reduced, to reduce resource consumption.
Based on the same inventive concept, a data processing apparatus corresponding to the data processing method is also provided in the embodiments of the present application, and since the principle of solving the problem of the apparatus in the embodiments of the present application is similar to the data processing method described above in the embodiments of the present application, reference may be made to the implementation of the apparatus for the method, and repeated parts are not described again.
Referring to fig. 4, a schematic diagram of a data processing apparatus 400 according to an embodiment of the present application is shown, where the data processing apparatus resides in a terminal device, and specifically includes: an obtaining module 401, a compressing module 402, and a sending module 403.
The acquiring module 401 is configured to acquire state data generated by the target application program in the running process, where the state data includes running state information of each target monitoring event after the target application program starts at least one target monitoring event;
a compression module 402, configured to perform data compression on the obtained state data according to a target compression manner, so as to obtain compressed state data;
a sending module 403, configured to send the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compressed state data based on the determined decompression mode so as to determine the running state of the target monitoring event.
In one embodiment, the target application is a travel application and the target monitoring events include monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
In an embodiment, the target monitoring event includes a plurality of target monitoring events, the target compression mode is a secondary compression mode including a first data compression mode and a second data compression mode, and the compression module 302, when being configured to perform data compression on the obtained state data according to the target compression mode to obtain compressed state data, includes:
performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on the intermediate compression state data corresponding to the target monitoring events to obtain final compressed compression state data; the second data compression is a packed compression.
In an embodiment, the state data includes an attribute tag, and the compressing module 402, when configured to perform first data compression on at least one piece of bar-state data corresponding to each target monitoring event to obtain intermediate compressed state data corresponding to the target monitoring event, includes:
aiming at each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label so as to shorten the byte length occupied by the state data; and/or the presence of a gas in the gas,
and deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
In one embodiment, the compression module 402 is further configured to, before performing the second data compression on the intermediate compression state data corresponding to the target monitoring events:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
if so, encrypting the user information.
According to the data processing device provided by the embodiment of the application, after the state data generated by the target application program in the operation process is acquired, the acquired state data is subjected to data compression according to a target compression mode, and then the compressed state data and the target compression mode are sent to the background server, so that the background server decompresses the compressed state data based on the determined decompression mode, and then determines the operation state of the target monitoring event.
The status data is data that needs to be received by the background server in time to determine the operation status of some important functions in the target application program, and therefore the status data needs to be sent to the background server in time, for example, sent to the background server at a short time interval.
As shown in fig. 5, for another data processing apparatus 500 provided in the embodiment of the present application, the data processing apparatus 500 resides in a backend server, and specifically includes:
the decompression module 501 is configured to decompress the compressed state data according to a decompression mode corresponding to the target compression mode after receiving the compressed state data and the target compression mode uploaded by the terminal device, so as to obtain state data of each target monitoring event started by the target application program; the state data comprises a timestamp and a state code generated by the state data;
the determining module 502 is configured to determine, based on a timestamp corresponding to the status data of each target monitoring event, a type of the status code, and a set number threshold, whether an operating state corresponding to the status code of the target type exists after the target monitoring event is triggered.
In one embodiment, the target compression mode includes a first data compression mode and a second data compression mode, and the decompression module, when configured to decompress the compressed state data according to a decompression mode corresponding to the target compression mode, includes:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event aiming at the intermediate compression state data corresponding to each target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
In one embodiment, before decompressing, for the intermediate compressed state data corresponding to each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event according to the first decompression manner corresponding to the first data compression of the target monitoring event, and obtaining decompressed state data corresponding to each target monitoring event, the decompressing module 501 is further configured to:
judging whether the intermediate compression state data contains encrypted user information;
if yes, determining an encryption algorithm corresponding to the user information based on the target compression mode, and then decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
In one embodiment, the decompression module 501 is configured to decompress the intermediate compressed state data corresponding to each target monitoring event according to a first decompression method corresponding to the first data compression of the target monitoring event for the intermediate compressed state data corresponding to each target monitoring event to obtain decompressed state data corresponding to each target monitoring event, and includes:
aiming at each identification character contained in the intermediate compression state data, replacing the identification character according to the attribute label corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute label in the intermediate compression state data; and/or the presence of a gas in the atmosphere,
and adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
In one embodiment, the status data includes a plurality of pieces, and the determining module 502, when configured to determine whether an operating status corresponding to the status code of the target type exists after the target monitoring event is triggered, based on the timestamp, the type of the status code, and the set number threshold corresponding to the status data of each target monitoring event, includes:
determining at least one continuous time corresponding to the state code of the target type based on the timestamp and the state code contained in each piece of state data;
judging whether the maximum value of at least one continuous time reaches a set time threshold value;
and when the maximum value of at least one continuous time reaches a set time threshold value, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered.
In one embodiment, the status data includes a plurality of pieces, and the determining module 502, when configured to determine at least one consecutive number of times corresponding to the status code of the target type based on the timestamp and the status code included in each piece of status data, includes:
sequencing the plurality of pieces of state data according to the time stamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding serial number of each piece of state data in the first sequence;
updating the sequence numbers of the state data containing the same state code in the first sequence according to the time stamp corresponding to the state data to obtain a second sequence containing the state data with the updated corresponding sequence numbers and the corresponding sequence number of each piece of state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed from the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the same serial number difference value corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
The data processing apparatus provided in this application embodiment may decompress, after receiving the compressed state data and the target compression mode uploaded by the terminal device, the compressed state data according to the decompression mode corresponding to the target compression mode to obtain the state data of each target monitoring event started by the target application program, and then further determine, based on the state data corresponding to each target monitoring event including the timestamp and the state code generated by the state data, whether the operating state corresponding to the state code of the target type exists after the target monitoring event is triggered, that is, the data processing apparatus according to this application embodiment may reduce the compressed state data uploaded by the terminal device and further determine the operating state of the target application program, so that the state data is compressed by the mobile terminal, and the background server further decompresses the state data, thereby reducing the occupancy rate of such data on the data transmission channel, to reduce resource consumption.
The description of the processing flow of each module in the apparatus and the interaction flow between the modules may refer to the relevant description in the above method embodiments, and will not be described in detail here.
An embodiment of the present application further provides an electronic device, where the electronic device may be a terminal device or a background server, and when the electronic device is a terminal device, as shown in fig. 6, a schematic structural diagram of the electronic device 600 provided in the embodiment of the present application is shown, and the electronic device includes: a processor 601, a storage medium 602, and a bus 603. The storage medium 602 stores machine-readable instructions executable by the processor 601 (for example, execution instructions corresponding to the obtaining module 401, the compressing module 402, and the sending module 403 in the apparatus in fig. 4, and the like), when the electronic device 600 runs, the processor 601 and the storage medium 602 communicate with each other through the bus 603, and when the machine-readable instructions are executed by the processor 601, the following processing is performed:
acquiring state data generated by a target application program in the running process, wherein the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event;
performing data compression on the acquired state data according to a target compression mode to obtain compressed state data;
sending the compression state data and the target compression mode to a background server; and the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compressed state data based on the determined decompression mode so as to determine the running state of the target monitoring event.
In one possible embodiment, the processor 601 executes instructions in which the target application is a travel application and the target monitoring event includes monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
In one possible embodiment, the target monitoring event includes a plurality of events, and the instructions executed by the processor 601 include:
performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on the intermediate compression state data corresponding to the target monitoring events to obtain final compressed compression state data; the second data compression is a packed compression.
In one possible embodiment, the state data includes an attribute tag, and the instructions executed by the processor 601 include:
for each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label to shorten the byte length occupied by the state data; and/or the presence of a gas in the atmosphere,
and deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
In a possible embodiment, before performing the second data compression on the intermediate compression state data corresponding to the plurality of target monitoring events, the instructions executed by the processor 601 further include:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
if so, encrypting the user information.
When the electronic device is a background server, as shown in fig. 7, a schematic structural diagram of an electronic device 700 provided in the embodiment of the present application includes: a processor 701, a storage medium 702, and a bus 703. The storage medium 702 stores machine-readable instructions (e.g., executable instructions corresponding to the decompression module 501 and the determination module 502 in the apparatus in fig. 5, etc.) executable by the processor 701, when the electronic device 700 is running, the processor 701 communicates with the storage medium 702 through the bus 703, and when the machine-readable instructions are executed by the processor 701, the following processes are performed:
after receiving the compressed state data and the target compression mode uploaded by the terminal equipment, decompressing the compressed state data according to a decompression mode corresponding to the target compression mode to obtain state data of each target monitoring event started by the target application program; the state data comprises a timestamp and a state code generated by the state data;
and determining whether the running state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and a set time threshold.
In one possible embodiment, the target compression mode includes a first data compression mode and a second data compression mode, and the instructions executed by the processor 701 include:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
In a possible implementation manner, the instructions executed by the processor 701 further include:
for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event, and judging whether the intermediate compression state data contain encrypted user information before the decompressed state data corresponding to each target monitoring event is obtained;
and if yes, determining an encryption algorithm corresponding to the user information based on the target compression mode, and decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
In one possible embodiment, the intermediate compression state data includes a plurality of identification characters, and the instructions executed by the processor 701 include:
aiming at each identification character contained in the intermediate compression state data, replacing the identification character according to the attribute label corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute label in the intermediate compression state data; and/or the presence of a gas in the atmosphere,
adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
In one possible embodiment, the state data includes a plurality of pieces, and the instructions executed by the processor 701 include:
determining at least one continuous time corresponding to the state code of the target type based on the timestamp and the state code contained in each piece of state data;
judging whether the maximum value of at least one continuous time reaches a set time threshold value;
and when the maximum value of at least one continuous time reaches a set time threshold value, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered.
In one possible implementation, the instructions executed by the processor 701 include:
sequencing the plurality of pieces of state data according to the time stamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding serial number of each piece of state data in the first sequence;
updating the sequence numbers of the state data containing the same state code in the first sequence according to the time stamp corresponding to the state data to obtain a second sequence containing the state data with the updated corresponding sequence numbers and the corresponding sequence number of each piece of state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed with the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the same serial number difference value corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
The embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the data processing method.
Specifically, the storage medium can be a general-purpose storage medium, such as a removable disk, a hard disk, and the like, and when the computer program on the storage medium is executed, the data processing method can be executed, so as to reduce the occupancy rate of the data transmission channel and reduce the consumption of channel resources.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to corresponding processes in the method embodiments, and are not described in detail in this application. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice, and for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some communication interfaces, indirect coupling or communication connection between devices or modules, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk, and various media capable of storing program codes.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (20)

1. A data processing method is applied to terminal equipment, and is characterized by comprising the following steps:
acquiring state data generated by a target application program in the running process, wherein the state data comprises running state information of each target monitoring event after the target application program starts at least one target monitoring event, the state data comprises running conditions for representing functions in the target application program so as to modify the target application program, and the state data is approximate rate continuous data;
performing data compression on the acquired state data according to a target compression mode to obtain compressed state data;
sending the compression state data and the target compression mode to a background server; the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compression state data based on the determined decompression mode to determine the running state of the target monitoring event;
the running state of the target monitoring event is obtained by the background server based on a judgment that whether the maximum value of at least one continuous time corresponding to the state code of the target type reaches a set time threshold or not, the at least one continuous time corresponding to the state code of the target type is determined by the background server based on the timestamp and the state code in each piece of state data obtained by decompression, and when the at least one continuous time corresponding to the state code of the target type reaches the set time threshold, it is determined that the target monitoring time is triggered, and then the running state corresponding to the state code of the target type exists; at least one continuous time corresponding to the state code of the target type is the repetition time of the same serial number difference value corresponding to the state code of the target type, the serial number difference value corresponding to each piece of state data is obtained by subtracting the serial number corresponding to each piece of state data in the first sequence from the serial number corresponding to the piece of state data in the second sequence, the first sequence of the state data and the corresponding sequence number of each state data in the first sequence are the time stamps contained in each state data, and sequencing the plurality of pieces of state data to obtain a second sequence containing the state data with the updated corresponding serial numbers and updating the serial numbers of the state data in the second sequence, wherein the serial numbers of the state data in the second sequence are obtained by updating the serial numbers of the state data containing the same state code in the first sequence according to the time stamp corresponding to the state data.
2. The data processing method of claim 1, wherein the target application is a travel application, and the target monitoring event comprises monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
3. The data processing method according to claim 1, wherein the target monitoring event includes a plurality of target compression modes, the target compression mode is a secondary compression mode including a first data compression mode and a second data compression mode, and the data compression is performed on the acquired state data according to the target compression mode to obtain compressed state data, including:
performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on intermediate compression state data corresponding to the target monitoring events to obtain final compressed compression state data; and the second data compression is packing compression.
4. The data processing method according to claim 3, wherein the state data includes an attribute tag, and for at least one piece of bar-state data corresponding to each target monitoring event, performing first data compression on the at least one piece of bar-state data to obtain intermediate compressed state data corresponding to the target monitoring event, the method includes:
for each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label to shorten the byte length occupied by the state data; and/or the presence of a gas in the atmosphere,
and deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
5. The data processing method according to claim 3, wherein before performing the second data compression on the intermediate compression state data corresponding to the target monitoring events, the method further comprises:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
and if so, encrypting the user information.
6. A data processing method is applied to a background server, and comprises the following steps:
after receiving compressed state data and a target compression mode uploaded by a terminal device, decompressing the compressed state data according to a decompression mode corresponding to the target compression mode to obtain state data of each target monitoring event started by a target application program; the state data comprises a timestamp and a state code generated by the state data, wherein the state data comprises the running condition of a function in the target application program so as to modify the target application program, and the state data is approximate rate continuous data;
determining whether an operating state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and a set time threshold;
the determining, based on the timestamp, the type of the status code, and the set number threshold corresponding to the status data of each target monitoring event, whether an operating status corresponding to the status code of the target type exists after the target monitoring event is triggered includes:
when the maximum value of at least one continuous time corresponding to the state code of the target type is determined to reach the set time threshold value based on the timestamp and the state code in each piece of state data, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered;
the determining at least one continuous time corresponding to the state code of the target type based on the timestamp and the state code included in each piece of state data includes:
sequencing the plurality of pieces of state data according to the timestamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding sequence number of each piece of state data in the first sequence;
updating the serial numbers of the state data containing the same state code in the first sequence according to the timestamp corresponding to the state data to obtain a second sequence containing the updated state data of the corresponding serial numbers and the corresponding serial number of each state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed from the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the same serial number difference value corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
7. The data processing method according to claim 6, wherein the target compression method includes a first data compression and a second data compression, and the decompressing the compression state data in a decompression method corresponding to the target compression method includes:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and for the intermediate compression state data corresponding to each target monitoring event, decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
8. The data processing method according to claim 7, wherein before the intermediate compressed state data corresponding to each target monitoring event is decompressed according to a first decompression mode corresponding to the first data compression of the target monitoring event, and decompressed state data corresponding to each target monitoring event is obtained, the data processing method further comprises:
judging whether the intermediate compression state data contains encrypted user information or not;
if yes, determining an encryption algorithm corresponding to the user information based on the target compression mode, and decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
9. The data processing method according to claim 7, wherein the intermediate compressed state data includes a plurality of identification characters, and for the intermediate compressed state data corresponding to each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event is decompressed in a first decompression manner corresponding to first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event, the method including:
aiming at each identification character contained in the intermediate compression state data, replacing the identification character according to an attribute label corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute label in the intermediate compression state data; and/or the presence of a gas in the atmosphere,
and adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
10. A data processing apparatus residing in a terminal device, the data processing apparatus comprising:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring state data generated by a target application program in the operation process, the state data comprises operation state information of each target monitoring event after the target application program starts at least one target monitoring event, the state data comprises operation conditions for representing functions in the target application program so as to modify the target application program, and the state data is approximate rate continuous data;
the compression module is used for carrying out data compression on the obtained state data according to a target compression mode to obtain compressed state data;
the sending module is used for sending the compression state data and the target compression mode to a background server; the target compression mode is used for determining a corresponding decompression mode by the background server, and decompressing the compression state data based on the determined decompression mode to determine the running state of the target monitoring event;
the running state of the target monitoring event is obtained by the background server based on a judgment that whether the maximum value of at least one continuous time corresponding to the state code of the target type reaches a set time threshold or not, the at least one continuous time corresponding to the state code of the target type is determined by the background server based on the timestamp and the state code in each piece of state data obtained by decompression, and when the at least one continuous time corresponding to the state code of the target type reaches the set time threshold, it is determined that the target monitoring time is triggered, and then the running state corresponding to the state code of the target type exists; at least one continuous time corresponding to the state code of the target type is the repetition time of the same serial number difference value corresponding to the state code of the target type, the serial number difference value corresponding to each piece of state data is obtained by subtracting the serial number corresponding to each piece of state data in the first sequence from the serial number corresponding to the piece of state data in the second sequence, the first sequence of the state data and the corresponding sequence number of each state data in the first sequence are the time stamps contained in each state data, and sequencing the plurality of pieces of state data, wherein the second sequence containing the state data with the updated corresponding serial number and the serial number of each piece of state data in the second sequence are obtained by updating the serial numbers of the state data containing the same state code in the first sequence according to the time stamp corresponding to the state data.
11. The data processing apparatus of claim 10, wherein the target application is a travel application and the target monitoring events include monitoring vehicle mileage data, monitoring vehicle travel speed data, and monitoring vehicle trip price data.
12. The data processing apparatus according to claim 10, wherein the target monitoring event includes a plurality of target compression manners, the target compression manner is a secondary compression manner that includes a first data compression manner and a second data compression manner, and the compression module, when being configured to perform data compression on the acquired state data according to the target compression manner to obtain compressed state data, includes:
performing first data compression on at least one strip state data corresponding to each target monitoring event to obtain intermediate compression state data corresponding to the target monitoring event;
performing second data compression on intermediate compression state data corresponding to a plurality of target monitoring events to obtain finally compressed compression state data; and the second data is compressed into a packing compression.
13. The data processing apparatus according to claim 12, wherein the status data includes an attribute tag, and the compression module, when being configured to perform first data compression on at least one piece of status data corresponding to each target monitoring event to obtain intermediate compressed status data corresponding to the target monitoring event, includes:
for each attribute label contained in the state data, replacing the attribute label according to the identification character corresponding to the attribute label to shorten the byte length occupied by the state data; and/or the presence of a gas in the atmosphere,
deleting characters at set positions in the state data corresponding to the target monitoring event so as to shorten the byte length occupied by the state data.
14. The data processing apparatus of claim 12, wherein the compression module, before performing the second data compression on the intermediate compression state data corresponding to the plurality of target monitoring events, is further configured to:
judging whether the intermediate compression state data contains user information corresponding to the terminal equipment;
and if so, encrypting the user information.
15. A data processing apparatus residing on a backend server, the data processing apparatus comprising:
the decompression module is used for decompressing the compressed state data according to a decompression mode corresponding to the target compression mode after receiving the compressed state data and the target compression mode uploaded by the terminal equipment to obtain state data of each target monitoring event started by the target application program; the state data comprises a timestamp and a state code generated by the state data, wherein the state data comprises a running condition for representing functions in the target application program so as to modify the target application program, and the state data is approximate rate continuous data;
the determining module is used for determining whether an operating state corresponding to the state code of the target type exists after the target monitoring event is triggered based on the timestamp corresponding to the state data of each target monitoring event, the type of the state code and a set time threshold;
the determining module is configured to determine whether an operating state corresponding to a state code of a target type exists after the target monitoring event is triggered based on the timestamp, the type of the state code, and a set number threshold corresponding to the state data of each target monitoring event, and includes:
when the maximum value of at least one continuous time corresponding to the state code of the target type is determined to reach the set time threshold value based on the timestamp and the state code in each piece of state data, determining that the running state corresponding to the state code of the target type exists after the target monitoring event is triggered;
when the determining module is configured to determine at least one consecutive number of times corresponding to the status code of the target type based on the timestamp and the status code included in each piece of status data, the determining module includes:
sequencing the plurality of pieces of state data according to the timestamp contained in each piece of state data to obtain a first sequence containing the state data and a corresponding sequence number of each piece of state data in the first sequence;
updating the serial numbers of the state data containing the same state code in the first sequence according to the timestamp corresponding to the state data to obtain a second sequence containing the state data with the updated corresponding serial numbers and the corresponding serial number of each piece of state data in the second sequence;
the sequence number corresponding to each piece of state data in the first sequence is differed from the sequence number corresponding to the piece of state data in the second sequence to obtain a sequence number difference value corresponding to each piece of state data;
and taking the repetition times of the difference value of the same serial number corresponding to the state code of the target type as at least one continuous time corresponding to the state code of the target type.
16. The data processing apparatus according to claim 15, wherein the target compression scheme includes a first data compression and a second data compression, and the decompression module, when configured to decompress the compression state data in a decompression scheme corresponding to the target compression scheme, comprises:
decompressing the compressed state data according to a second decompression mode corresponding to the second data compression to obtain intermediate compressed state data corresponding to each target monitoring event;
and decompressing the intermediate compression state data corresponding to the target monitoring event according to a first decompression mode corresponding to the first data compression of the target monitoring event aiming at the intermediate compression state data corresponding to each target monitoring event to obtain decompressed state data corresponding to each target monitoring event.
17. The data processing apparatus according to claim 16, wherein the decompression module is further configured to, before decompressing, for each target monitoring event, the intermediate compressed state data corresponding to the target monitoring event in accordance with a first decompression manner corresponding to the first data compression of the target monitoring event to obtain decompressed state data corresponding to each target monitoring event:
judging whether the intermediate compression state data contains encrypted user information or not;
if yes, determining an encryption algorithm corresponding to the user information based on the target compression mode, and then decrypting the encrypted user information according to a decryption algorithm corresponding to the encryption algorithm.
18. The data processing apparatus according to claim 16, wherein the intermediate compressed state data includes a plurality of identification characters, and the decompression module is configured to, for the intermediate compressed state data corresponding to each target monitoring event, decompress the intermediate compressed state data corresponding to the target monitoring event in a first decompression manner corresponding to first data compression of the target monitoring event, and obtain decompressed state data corresponding to each target monitoring event, and includes:
for each identification character contained in the intermediate compression state data, replacing the identification character according to the attribute tag corresponding to the identification character so as to restore the byte length occupied by the character representing the attribute tag in the intermediate compression state data; and/or the presence of a gas in the gas,
adding a character corresponding to the set position at the set position in the intermediate compression state data corresponding to the target monitoring event so as to restore the byte length occupied by the character at the set position.
19. An electronic device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the data processing method according to any one of claims 1 to 9.
20. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of a data processing method according to any one of claims 1 to 9.
CN201911229011.6A 2019-12-04 2019-12-04 Data processing method and device, electronic equipment and storage medium Active CN111835700B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911229011.6A CN111835700B (en) 2019-12-04 2019-12-04 Data processing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911229011.6A CN111835700B (en) 2019-12-04 2019-12-04 Data processing method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111835700A CN111835700A (en) 2020-10-27
CN111835700B true CN111835700B (en) 2022-07-22

Family

ID=72911721

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911229011.6A Active CN111835700B (en) 2019-12-04 2019-12-04 Data processing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111835700B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112968751A (en) * 2021-01-27 2021-06-15 伊之密机器人自动化科技(苏州)有限公司 Industrial time sequence data compression method and system
CN113536060B (en) * 2021-06-23 2024-04-16 上海市计算技术研究所有限公司 Data acquisition device and method, electronic device and computer storage medium
CN113487275B (en) * 2021-06-29 2022-02-11 北京三维天地科技股份有限公司 Laboratory detection report management system based on block chain
CN114449041A (en) * 2021-12-30 2022-05-06 东软集团股份有限公司 Data transmission method, device, storage medium and electronic equipment
CN115297182B (en) * 2022-06-29 2023-04-07 江苏英达思自动化技术有限公司 Remote transmission method and system for control cabinet running state data
CN115598559B (en) * 2022-12-16 2023-03-14 深圳市云帆自动化技术有限公司 Intelligent UPS battery health state monitoring system

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1760914A (en) * 2005-11-01 2006-04-19 中国地质调查局发展研究中心 Network gridding service system of national geolopy spatial data
US7162643B1 (en) * 2001-06-15 2007-01-09 Informatica Corporation Method and system for providing transfer of analytic application data over a network
CN102445940A (en) * 2011-09-28 2012-05-09 马秀文 Car monitoring and diagnosing system
CN102932465A (en) * 2012-11-08 2013-02-13 北京工商大学 Method for monitoring user interaction characteristics of efficient smart phone
CN104571064A (en) * 2015-01-27 2015-04-29 蒋雨兰 Intelligent management and control system for internet of things vehicle-mounted cloud platform
CN106375379A (en) * 2016-08-26 2017-02-01 无锡挪瑞科技股份有限公司 Method and system for returning ship related data after being compressed to shore-based server
CN107026799A (en) * 2017-03-01 2017-08-08 杭州伯坦科技工程有限公司 The flow control methods of new-energy automobile car networking system onboard terminal
CN107390564A (en) * 2016-05-16 2017-11-24 云南力帆骏马车辆有限公司 A kind of Research on Vehicle Remote Monitoring System Based on GPRS
CN107590054A (en) * 2017-09-21 2018-01-16 大连君方科技有限公司 Ship server log monitoring system
CN108924766A (en) * 2018-08-07 2018-11-30 天津五八到家科技有限公司 Position data method for uploading, Method for Calculate Mileage and device
CN109450926A (en) * 2018-12-06 2019-03-08 成都路行通信息技术有限公司 A kind of travelling data packet compression opportunity calculation method and data packet compressing device
CN109947632A (en) * 2017-12-20 2019-06-28 瑞萨电子株式会社 Tracking data compression method selecting equipment, methods and procedures
CN110493116A (en) * 2018-05-14 2019-11-22 广州小鹏汽车科技有限公司 A kind of car networking data transmission method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018077764A (en) * 2016-11-11 2018-05-17 東京エレクトロン株式会社 Abnormality detection system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7162643B1 (en) * 2001-06-15 2007-01-09 Informatica Corporation Method and system for providing transfer of analytic application data over a network
CN1760914A (en) * 2005-11-01 2006-04-19 中国地质调查局发展研究中心 Network gridding service system of national geolopy spatial data
CN102445940A (en) * 2011-09-28 2012-05-09 马秀文 Car monitoring and diagnosing system
CN102932465A (en) * 2012-11-08 2013-02-13 北京工商大学 Method for monitoring user interaction characteristics of efficient smart phone
CN104571064A (en) * 2015-01-27 2015-04-29 蒋雨兰 Intelligent management and control system for internet of things vehicle-mounted cloud platform
CN107390564A (en) * 2016-05-16 2017-11-24 云南力帆骏马车辆有限公司 A kind of Research on Vehicle Remote Monitoring System Based on GPRS
CN106375379A (en) * 2016-08-26 2017-02-01 无锡挪瑞科技股份有限公司 Method and system for returning ship related data after being compressed to shore-based server
CN107026799A (en) * 2017-03-01 2017-08-08 杭州伯坦科技工程有限公司 The flow control methods of new-energy automobile car networking system onboard terminal
CN107590054A (en) * 2017-09-21 2018-01-16 大连君方科技有限公司 Ship server log monitoring system
CN109947632A (en) * 2017-12-20 2019-06-28 瑞萨电子株式会社 Tracking data compression method selecting equipment, methods and procedures
CN110493116A (en) * 2018-05-14 2019-11-22 广州小鹏汽车科技有限公司 A kind of car networking data transmission method and device
CN108924766A (en) * 2018-08-07 2018-11-30 天津五八到家科技有限公司 Position data method for uploading, Method for Calculate Mileage and device
CN109450926A (en) * 2018-12-06 2019-03-08 成都路行通信息技术有限公司 A kind of travelling data packet compression opportunity calculation method and data packet compressing device

Also Published As

Publication number Publication date
CN111835700A (en) 2020-10-27

Similar Documents

Publication Publication Date Title
CN111835700B (en) Data processing method and device, electronic equipment and storage medium
US8639662B2 (en) Methods and apparatus for content based notification using hierarchical groups
CN108268211B (en) Data processing method and device
EP2759929B1 (en) A radio handheld device and method for starting the radio handheld device
CN107105324B (en) Method and client for protecting bullet screen information
JP5753946B2 (en) Method and system for downloading font files
CN107835206A (en) Data-updating method, server and computer-readable recording medium
CN110381378B (en) Estimation method, device, server and storage medium of network multimedia playing amount
CN113961226B (en) Software development kit repairing method, terminal, server and equipment
CN115473722A (en) Data encryption method and device, electronic equipment and storage medium
CN109561045B (en) Data interception method and device, storage medium and electronic equipment
CN113986313A (en) Software upgrading method and device, electronic equipment and storage medium
CN112182602A (en) Disk residual information protection method and device and computer readable storage medium
CN116776352A (en) Data processing method and device
CN114095037B (en) Application program updating method, updating data compression method, device and equipment
CN112823349A (en) Data processing method, data processing device, electronic equipment and storage medium
CN110489988B (en) Method and device for calculating number of exposure equipment
CN105204937B (en) Kernel function call method, apparatus and operating system
CN113992345A (en) Method and device for encrypting and decrypting webpage sensitive data, electronic equipment and storage medium
CN114357520A (en) File generation method and device and file coding information sending method and device
CN111414341B (en) Data normalization description method in Internet of things environment
CN107678928B (en) Application program processing method and server
WO2015154398A1 (en) Data processing method and device
EP4057593A1 (en) Data intermediary system and data intermediary method
CN109409039A (en) The method and device reinforced for the compression data packet comprising resource file

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant