CN110545107A

CN110545107A - data processing method and device, electronic equipment and computer readable storage medium

Info

Publication number: CN110545107A
Application number: CN201910848834.0A
Authority: CN
Inventors: 陆舟; 于华章
Original assignee: Feitian Technologies Co Ltd
Current assignee: Feitian Technologies Co Ltd
Priority date: 2019-09-09
Filing date: 2019-09-09
Publication date: 2019-12-06
Anticipated expiration: 2039-09-09
Also published as: CN110545107B

Abstract

The present application relates to the field of information security technologies, and in particular, to a data processing method and apparatus, an electronic device, and a computer-readable storage medium. The method is applied to a computer terminal comprising a processor, a memory and an input device, and comprises the following steps: s101, acquiring an operation instruction input by a user through input equipment; s102, the processor acquires a corresponding original data set based on an operation instruction; s103, selecting an unprocessed data unit from the data units contained in the original data group by the processor, and performing table look-up analysis on the selected data unit to obtain the data type of the data unit; step S104, the processor selects a corresponding preset processing mode based on the data type; s105, the processor compresses the data unit according to a preset processing mode to obtain a compressed data unit; s106, the memory stores the data unit after the compression processing in a new data set. In the application, the compression processing rate and the data transmission speed are improved.

Description

data processing method and device, electronic equipment and computer readable storage medium

Technical Field

The present application relates to the field of information security, and in particular, to a data processing method and apparatus, an electronic device, and a computer-readable storage medium.

Background

With the rapid development of electronic information technology, in computer science and information theory, compression processing or source coding is a process of representing information by using fewer data bits or other information-related units than uncoded information according to a specific coding mechanism.

As the name implies, the existing compression processing is a technical method for compressing data as a whole without losing useful information, and reducing the storage space by reducing the data amount, thereby improving the transmission, storage and processing efficiency, or reorganizing the data according to a certain algorithm, and further reducing the redundancy of the data and the occupation of the storage space. How to implement data compression through other data processing manners, and further to improve the compression processing rate and the data transmission speed becomes a technical problem to be solved urgently at present.

disclosure of Invention

the application provides a data processing method, a data processing device, an electronic device and a computer readable storage medium, so as to compress data and further improve the compression processing rate and the data transmission speed.

in a first aspect, a data processing method is provided, which is applied to a computer terminal including a processor, a memory and an input device, and includes the following steps:

S101, acquiring an operation instruction input by a user through input equipment;

step S102, the processor acquires a corresponding original data set based on an operation instruction input by a user, wherein the original data set comprises data units;

s103, selecting an unprocessed data unit from the data units contained in the original data group by the processor, and performing table look-up analysis on the selected data unit to obtain the data type of the selected data unit;

step S104, the processor selects a corresponding preset processing mode based on the determined data type;

Step S105, the processor compresses the selected data unit according to a preset processing mode to obtain a compressed data unit;

Step S106, the memory stores the compressed data unit in a new data set;

step S107, the processor determines whether the original data group contains unprocessed data units; when the original data group contains unprocessed data units, executing step S103; and when the original data group does not contain unprocessed data units, ending the process.

in one possible implementation, the processor selects an unprocessed data unit from the data units included in the original data set, and performs table lookup analysis on the selected data unit to obtain the data type of the selected data unit, including:

The processor analyzes the selected data unit to obtain an analysis result;

The processor queries a preset table according to the analysis result to obtain a corresponding data type;

wherein, the data type comprises:

A first data type composed of at least one of an unsigned integer type, a negative integer type, a byte type, and a string type;

A second data type consisting of a word representative and/or an array type;

a third data type consisting of a specific type.

in one possible implementation, when the unprocessed data unit selected by the processor from the data units included in the original data group is the first selected data unit, the processor selects the first-ranked data unit from the data units included in the original data group;

in one possible implementation manner, the compressing the selected data unit according to a preset processing manner by the processor to obtain a compressed data unit includes:

when the data type is a first data type, the processor selects a corresponding first preset processing mode to compress the data unit based on the first data type to obtain a corresponding data unit;

When the data type is a second data type, the processor selects a corresponding second preset processing mode to compress the data unit based on the second data type to obtain a corresponding data unit;

when the data type is the third data type, no processing is performed.

in one possible implementation manner, the compressing the data unit by the processor according to the first preset processing manner selected by the processor based on the first data type to obtain the corresponding data unit includes:

the processor acquires the data length of the data unit and determines a corresponding data length type based on the data length;

And when the data unit can be written into the corresponding byte, the processor performs addition processing on the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit after the addition processing.

In one possible implementation manner, the compressing the data unit by the processor according to the second data type by selecting a corresponding second preset processing manner, so as to obtain a corresponding data unit, includes:

the processor determines whether the number of the data subunits of the data unit is limited;

when the number of the data subunits is limited, the processor acquires the data length of the data unit and determines the corresponding data length type based on the data length;

In one possible implementation manner, after step S103, the method further includes:

step S108, the processor determines whether the data unit contains a data subunit; when the data units comprise data subunits, the processor selects one data subunit from the data subunits contained in the data units, performs table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, selects a corresponding preset processing mode based on the determined data type, compresses the data subunit according to the preset processing mode to obtain the compressed data subunit, and stores the compressed data subunit in the corresponding position of the data unit in the new data group.

in one possible implementation, after step S108, the method further includes:

step S109, the processor determines whether the data unit contains unprocessed data sub-units; when the data unit contains unprocessed data sub-units, executing step S108; when the data unit does not include unprocessed data sub-units, the process goes to step S107.

in a second aspect, there is provided a data processing apparatus comprising:

The first acquisition unit is used for acquiring an operation instruction input by a user;

The second acquisition unit is used for acquiring a corresponding original data set based on an operation instruction input by a user, and the original data set comprises a data unit;

the first processing unit is used for selecting an unprocessed data unit from the data units contained in the original data group, and performing table look-up analysis on the selected data unit to obtain the data type of the selected data unit;

the selection unit is used for selecting a corresponding preset processing mode based on the determined data type;

The second processing unit is used for compressing the selected data unit according to a preset processing mode to obtain a compressed data unit;

the storage unit is used for storing the data unit after the compression processing into a new data set;

The third processing unit is used for determining whether the original data group contains unprocessed data units; when the original data group contains unprocessed data units, triggering a first processing unit to process; and when the original data group does not contain unprocessed data units, ending the process.

In one possible implementation, the first processing unit is configured to analyze the selected data unit to obtain an analysis result; inquiring a preset table according to the analysis result to obtain a corresponding data type;

Wherein, the data type comprises:

A second data type consisting of a word representative and/or an array type;

A third data type consisting of a specific type.

In one possible implementation, the first processing unit is configured to select a first-ranked data unit from the data units included in the original data group when the unprocessed data unit selected from the data units included in the original data group is the first-selected data unit.

In one possible implementation of the method of the invention,

The second processing unit is used for selecting a corresponding first preset processing mode to compress the data unit based on the first data type to obtain a corresponding data unit when the data type is the first data type; the data unit compression processing module is used for selecting a corresponding second preset processing mode based on the second data type to compress the data unit to obtain a corresponding data unit when the data type is the second data type; for performing no processing when the data type is the third data type.

in one possible implementation, the second processing unit is specifically configured to obtain a data length of the data unit, and determine a corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to the addition processing.

in one possible implementation, the second processing unit is specifically configured to determine whether the number of data sub-units of the data unit is limited; when the number of the data subunits is limited, acquiring the data length of the data unit, and determining the corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to the addition processing.

In one possible implementation, the method further includes:

the fourth processing unit is used for determining whether the data unit contains the data sub-unit; when the data units comprise data subunits, selecting one data subunit from the data subunits contained in the data units, performing table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, selecting a corresponding preset processing mode based on the determined data type, compressing the data subunit according to the preset processing mode to obtain the compressed data subunit, and storing the compressed data subunit in the corresponding position of the data unit in the new data group.

in one possible implementation, the method further includes:

A fifth processing unit, configured to determine whether the data unit includes an unprocessed data sub-unit; when the data unit contains unprocessed data subunits, the fourth processing unit is switched to for processing; and when the data unit does not contain unprocessed data subunits, the third processing unit is switched to for processing.

In a third aspect, an electronic device is provided, including: a processor and a memory;

a memory for storing operating instructions;

and the processor is used for executing the data processing method by calling the operation instruction.

In a fourth aspect, a computer-readable storage medium is provided for storing computer instructions which, when executed on a computer, cause the computer to perform the data processing method described above.

By means of the technical scheme, the technical scheme provided by the application at least has the following advantages:

Compared with the prior art, the data compression method and the data compression device have the advantages that data compression is achieved, and compression processing rate and data transmission speed are improved.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the embodiments of the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 is a schematic flow chart of a data processing method provided in the present application;

FIG. 2 is a schematic processing flow diagram of one possible implementation of the data processing method provided in the present application;

FIG. 3 is a schematic structural diagram of a data processing apparatus provided in the present application;

fig. 4 is a schematic structural diagram of an electronic device of the data processing method provided in the present application.

Detailed Description

The present application provides a data processing method, an apparatus, an electronic device, and a computer-readable storage medium, and the following describes in detail embodiments of the present application with reference to the accompanying drawings.

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

as used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

As shown in fig. 1, a schematic flow chart of a data processing method provided by the present application is applied to a computer terminal including a processor, a memory and an input device, and the method includes the following steps:

Step S101, an input device acquires an operation instruction input by a user;

Step S106, the memory stores the compressed data unit in a new data set;

The processor analyzes the selected data unit to obtain an analysis result;

wherein, the data type comprises:

a second data type consisting of a word representative and/or an array type;

a third data type consisting of a specific type.

in one possible implementation, when the unprocessed data unit selected by the processor from the data units included in the original data group is the first selected data unit, the processor selects the first-ranked data unit from the data units included in the original data group.

In one possible implementation manner, the compressing the data unit according to a preset processing manner by the processor to obtain a compressed data unit includes:

When the data type is the third data type, no processing is performed.

Step S108 (not shown), the processor determines whether the data unit includes a data sub-unit; when the data units comprise data subunits, the processor selects one data subunit from the data subunits contained in the data units, performs table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, selects a corresponding preset processing mode based on the determined data type, compresses the data subunit according to the preset processing mode to obtain the compressed data subunit, and stores the compressed data subunit in the corresponding position of the data unit in the new data group.

in one possible implementation, after step S108, the method further includes:

Step S109 (not shown), the processor determines whether the data unit includes unprocessed data sub-units; when the data unit contains unprocessed data sub-units, executing step S108; when the data unit does not include unprocessed data sub-units, the process goes to step S107.

based on the technical solutions provided in the foregoing application, the following technical solutions are explained in detail, in which a computer terminal included in a system is taken as an execution subject to be explained, the computer terminal includes a processor, an input device, and a memory, as shown in fig. 2, which is a specific processing flowchart of one possible implementation manner of the data processing method provided in the present application.

step 201: the input device acquires an operation instruction input by a user.

In one possible implementation mode, when a user wants to perform the following operations, the user inputs an operation instruction corresponding to each operation on an input device of the computer terminal to enable the corresponding operation to be subsequently executed; the operations may include a registration operation, an authentication operation, a PIN code setting operation, a PIN code modifying operation, an equipment name modifying operation, a PIN remaining number modifying operation, and the like.

In step S202, the processor obtains a corresponding original data set based on an operation instruction input by the user.

in a possible implementation manner, the database of the computer terminal stores the corresponding relationship between each operation instruction and each original data set in advance, so that after the input device acquires the operation instruction input by the user, the processor finds the original data set corresponding to the operation instruction based on the corresponding relationship between the operation instruction stored in advance in the database and the original data set. For each original data group, at least two data units are contained, the at least two data units are arranged in sequence, and each data unit is formed in a K: V form, wherein K and V can be formed by combining letters and/or numbers.

in step S203, the processor determines the data type of the data unit in the original data set.

in a possible implementation manner, the processor selects an unprocessed data unit from the original data set, analyzes the unprocessed data unit to obtain a corresponding analysis result, and then queries a preset table according to the analysis result to obtain a corresponding data type.

specifically, the processor analyzes the data unit to obtain a corresponding K, V value, and queries the corresponding table according to K, V value, so as to determine the data type corresponding to the data unit.

in a possible implementation manner, when the processor selects the unprocessed data unit in the original data group, if the unprocessed data unit is selected for the first time, the processor may select an unprocessed data unit at will, or may select an unprocessed data unit based on a certain specific order, for example, the first data unit in the original data group is selected.

The data types corresponding to the data units can be divided into seven types according to requirements, wherein the seven types are respectively dictionary type, array type, unsigned integer type, negative integer type, character string type, byte type and specific type; the data types can be further divided into three types, namely a first data type comprising an unsigned integer type, a negative integer type, a byte type and a character string type; a second data type comprising a word representative and an array type; including a third data type of a particular type.

for the above types of data unit formats, the method may include:

When the data type of the data unit is a word typical type, creating and initializing a standard data unit format, setting the data type as the word typical type, setting the first flag bits as a preset number of data subunits, and storing the data units;

when the data type of the data unit is the array type, creating and initializing a standard data unit format, setting the data type to be the array type, and storing the data unit;

when the data type of the data unit is an unsigned integer, creating and initializing a standard data unit format, setting the data type to be an unsigned integer type, and setting a value corresponding to the data unit to be an acquired first data value;

when the data type of the data unit is a negative integer type, creating and initializing a standard data unit format, setting the data type to be an unsigned integer type, and setting the value corresponding to the data unit to be an acquired second data value;

when the data type of the data unit is a character string type, creating and initializing a standard data unit format, setting the data type to be an unsigned integer type, and setting a value corresponding to the data unit to be an acquired third data value;

When the data type of the data unit is byte type, creating and initializing a standard data unit format, setting the data type to be unsigned integer type, and setting the value corresponding to the data unit to be the acquired fourth data value;

and when the data type of the data unit is a specific type, creating and initializing a standard data unit format, setting the data type to be an unsigned integer type, and setting the value corresponding to the data unit to be the acquired fifth data value.

and step S204, the processor compresses the data unit according to the determined data type to obtain the compressed data unit.

In one possible implementation manner, after determining the data type, the processor selects different preset processing manners according to the difference of the data type to perform compression processing on the corresponding data unit, so as to obtain a compressed data unit.

based on the difference of the data types, corresponding preset processing mode configuration is performed in advance, and further, different data types in the same type correspond to the same preset processing mode, that is, a first data type corresponds to a corresponding first preset processing mode, a second data type corresponds to a corresponding second preset processing mode, and a third data type corresponds to a corresponding third preset processing mode.

The compressing the data unit by the processor based on the first preset processing mode may include:

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires the data length of the data unit and determines the data length type corresponding to the data unit according to the data length; further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, the processor performs addition processing on the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length, and writes the added processing result into a new data set; and when the data unit cannot be written into the corresponding byte, performing error reporting processing.

Further, if the data type corresponding to the current data unit is any one of the first data types, the processor obtains a first data length (len ═ 0x00 … 0x17) of the data unit, and determines that the data length type to which the data unit belongs is the first data length type (0x00+ type … 0x17+ type) according to the first data length; whether the data unit can be written into the corresponding byte is further determined, and when the data unit can be written into the corresponding byte, the numerical value corresponding to the determined first data length type and the numerical value corresponding to the first data length are added, and the added processing result is written into a new data set.

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires a second data length (len-one follow) of the data unit, and determines that the data length type corresponding to the data unit is a second data length type (0x18+ type) according to the second data length; and further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, adding the value corresponding to the determined second data length type and the value corresponding to the second data length, writing the added processing result into a new data group, and writing the real length value (namely the V value of the current data unit) into the next byte.

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires a third data length (len-two byte follow) of the data unit, and determines that the data length type to which the data unit belongs is a third data length type (0x19+ type) according to the third data length; and further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined second data length type and the numerical value corresponding to the third data length, writing the added processing result into a new data group, and writing the real length value into the next two bytes.

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires a fourth data length (len-byte follow) of the data unit, and determines that the data length type to which the data unit belongs is a fourth data length type (0x1a + type) according to the fourth data length; and further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined fourth data length type and the numerical value corresponding to the fourth data length, writing the added processing result into a new data group, and writing the real length value into the next four bytes.

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires a fifth data length (len-eight follow) of the data unit, and determines that the data length type to which the data unit belongs is a fifth data length type (0x1b + type) according to the fifth data length; and further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, adding the value corresponding to the determined fifth data length type and the value corresponding to the fifth data length, writing the added processing result into a new data group, and writing the real length value into the next four bytes.

if the data type corresponding to the current data unit is any one of the first data types, the processor acquires a sixth data length (other, that is, a data length other than the data length) of the data unit, and determines that the data length type to which the data unit belongs is a sixth data length type (0x1f + type) according to the sixth data length; and further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, performing addition processing on the numerical value corresponding to the determined sixth data length type and the numerical value corresponding to the sixth data length, and writing the added processing result into a new data set or directly writing the numerical value corresponding to the sixth data length type into the new data set.

The processor performs compression processing on the data unit based on a second preset processing mode, which may include:

if the data type corresponding to the current data unit is any one of the second data types, the processor firstly determines whether the number of the data subunits of the data unit is limited, if so, the data length of the data unit is obtained, and the data length type corresponding to the data unit is determined according to the data length; further determining whether the data unit can be written into the corresponding byte, and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length, and writing the added processing result into a new data set; when the data unit can not be written into the corresponding byte, error reporting processing is carried out; if the number is not limited, the specific data is directly written.

The processing after the limited number of the data sub-units of the data unit is the same as the description of the first preset processing mode, so that the detailed explanation is not provided herein.

further, for the third preset processing mode, if the data type corresponding to the current data unit is any one of the third data types, the processor does not perform any processing on the data unit.

In one possible implementation, after the processor adjusts the aforementioned data unit, the memory stores the adjusted data unit in the new data set.

in a possible implementation manner, after the memory stores the current data unit in the new data set, the processor further needs to determine whether the data unit includes a data subunit, and if the data unit includes a data subunit, the processing is performed according to the foregoing step S203 until all the data subunits in the data unit have performed the foregoing processing; otherwise, go directly to step S205 to process.

in step S205, the processor determines whether the original data set includes unprocessed data units.

In a possible implementation manner, after the memory stores the current data unit into the new data set, the processor needs to determine whether the data set includes unprocessed data units, and if there are unprocessed data units, the process returns to step S203 until the original data set does not include unprocessed data units; if the original data set does not include unprocessed data units, go to step S206.

When the processor selects the data units for the first time, the data units can be sequentially selected according to the arrangement sequence of the data units, and unprocessed data units can also be randomly selected.

In step S206, the flow ends.

based on the technical solutions described above, the technical solutions disclosed in the present application are explained below with a specific example.

in the embodiment of the application, the user operation is a setting PIN operation, and the original data set acquired by the device based on the setting PIN operation instruction is

{1:1,2:3,3:{1:2,3:-25,-1:1,-2:h'927E37CBA242A4884CC0DC9D15317E929238 21EF9F2124474B5ECC13613B7AEE',-3:h'E1B39E1381889C2EB54D2C696D9AF74CDFEA67804 6EFE81BA5A7427C22CA952A'},4:h'6F8E2117CBFA99E6C7DF7DEFDC973851',5:h'67F2C94F E054A7B6C3EFA4A4A204FB96FEE9D0D3A94481CD554FC9FA62DF83D39D98303F5671E91D9DD3 AB585BC69918F3E794B03DA6D8A6EC466F544AF55158'}。

Based on the original data set, the process of obtaining a new data set after the adjustment processing is as follows:

establishing a dictionary 1 based on each data unit in the original data group, and determining that the data type corresponding to the first data unit (1:1) in the original data group is an integer type.

Specifically, K and V in the data unit (1:1) are judged and determined to be integers, so that the data unit is determined to be an integer type, a data unit in a standard format is established, the data type in the data unit in the standard format is set to be the integer type, the data length of the data unit is further determined, the corresponding data length type is determined, then corresponding addition processing is carried out on the numerical value corresponding to the data length and the numerical value corresponding to the data length type, and the processing result is written into a new data group.

after the above processing, it is determined that the data unit does not contain a data sub-unit, and it is further determined that the original data group contains an unprocessed data unit (2: 3).

Judging and determining that K and V in the data unit (2:3) are both integers, so determining that the data unit is an integer type, establishing a data unit in a standard format, setting the data type in the data unit in the standard format to be the integer type, further determining the data length of the data unit, determining the corresponding data length type, then carrying out corresponding addition processing on the numerical value corresponding to the data length and the numerical value corresponding to the data length type, and writing the processing result into a new data group.

After the above processing, it is determined that the data unit does not contain a data sub-unit, and it is further determined that the original data set contains an unprocessed data unit (3: {1:2,3: -25, -1:1, -2: h '927E37CBA242A4884CC0DC9D15317E92923821EF9F2124474B5ECC13613B7AEE', -3: h 'E1B39E1381889C2EB54D2C696D9AF74CDFEA678046EFE81BA5A7427C22CA 952A').

And judging and determining that K in the data unit (3: {1:2,3: -25, -1:1, -2: h '927E37CBA242A4884CC0DC9D15317E92923821EF9F2124474B5ECC13613B7AEE ', -3: h ' E1B39E1381889C2EB54D2C696D9AF74CDFEA678046EFE81BA5A7427C22CA 952A) }) is an integer and V is a dictionary, establishing a data unit in a standard format, setting the data type in the data unit in the standard format as an integer, further determining the data length of the data unit and determining the corresponding data length type, and then performing corresponding addition processing on the numerical value corresponding to the data length and the numerical value corresponding to the data length type and writing the processing result into a new data group.

After the above-described processing, it was determined that the data unit contained data subunits ({1:2,3: 25, -1:1, -2: h '927E37CBA242A4884CC0DC9D15317E92923821EF9F2124474B5ECC13613B7AEE', -3: h 'E1B39E1381889C2EB54D2C696D9AF74CDFEA678046EFE81BA5A7427C22CA952A' }), so dictionary 2 was established. According to the above processing, the above processing is sequentially performed for each data subunit, and the processing result is stored in the dictionary 2.

further, it is determined that the raw data set contains unprocessed data elements (4: h '6F8E2117CBFA99E6C7DF7 DEDFDC 973851').

and judging and determining that K in the data unit (4: h '6F8E2117CBFA99E6C7DF7 DEFDDC 973851') is an integer and V is a character string, establishing a data unit in a standard format, further determining the data length of the data unit, determining the corresponding data length type of the data unit, then performing corresponding addition processing on the numerical value corresponding to the data length and the numerical value corresponding to the data length type, and writing the processing result into a new data group.

after the above processing, it is determined that the data unit does not contain a data sub-unit, and it is further determined that the original data group contains an unprocessed data unit (5: h '67F2C94FE054A7B6C3EFA4A 204FB96FEE9D0D3A94481CD554FC9FA62DF83D39D98303F5671E91D9 AB 3AB585BC69918F3E794B03DA6D8A6EC466F544AF 55158').

and judging and determining that K in the data unit (5: h '67F2C94FE054A7B6C3EFA4A 204FB96FEE9D0D3A94481CD554FC9FA62DF83D39D98303F5671E91D9DD3AB585BC69918F3E794B03DA6D8A6EC466F544AF55158') is an integer and V is a character string, establishing a data unit in a standard format, further determining the data length of the data unit, determining the corresponding data length type of the data unit, then performing corresponding addition processing on the numerical value corresponding to the data length and the numerical value corresponding to the data length type, and writing the processing result into a new data group.

After the processing, determining that the data unit does not contain the data subunit, further determining that the original data group does not contain the unprocessed data unit, and obtaining a new data group containing all the processed data units based on the determination. Wherein the data unit in the new data set comprises:

06 a5 01 01 02 03 03 a5 01

02 03 38 18 20 01 21 58 20 bc a8 0e 1d 73 a3 fb

ba f0 c7 62 20 95 76 de ae eb bc 55 1c 6e 96 c6

10 ff d1 9e 3f 5d f4 99 5a 22 58 20 8d 1a 76 3d

2d 6a f5 10 8c 52 43 16 3a fb bb

e2 46 59 03 c7 ad bb c6 f1 07 c2 24 88 4f 09 01

89 04 50 36 b6 83 d4 8e b3 6a 78 e6 90 93 f0 34

a7 d7 61 05 58 40 c9 fc 11 0d 49 44 d3 e3 a0 97

97 87 93 54 a3 36 eb 87 ac e8 57

4e da 00 71 52 21 f5 ed f5 d2 c2 46 16 dd 44 14

ec 98 fb 34 3d 07 16 c9 ff 5e a4 97 85 92 b2 18

15 0a 46 50 99 34 2a dc 9e a1 03 00 00 00 00 00

of course, the execution sequence in the embodiment of the present application is only for illustrating one possible execution scheme of the technical solution of the present application, but is not limited to the execution sequence in the embodiment.

In the application, the data compression is realized, and the compression processing rate and the data transmission speed are improved.

Based on the above technical solution of the data processing method provided by the present application, the present application correspondingly provides a schematic structural diagram of a data processing apparatus, and as shown in fig. 3, the data processing apparatus 30 of the present application may include: a first acquisition unit 31, a second acquisition unit 32, a first processing unit 33, a selection unit 34, a second processing unit 35, a storage unit 36, a third processing unit 37, a fourth processing unit 38, and a fifth processing unit 39, wherein,

A first acquisition unit 31 for acquiring an operation instruction input by a user;

A second obtaining unit 32, configured to obtain a corresponding original data group based on an operation instruction input by a user, where the original data group includes a data unit;

The first processing unit 33 is configured to select one data unit from the data units included in the original data group, perform table lookup analysis on the selected data unit, and obtain a data type of the selected data unit;

A selecting unit 34, configured to select a corresponding preset processing manner based on the determined data type;

The second processing unit 35 is configured to perform compression processing on the selected data unit according to a preset processing mode to obtain a compressed data unit;

a storage unit 36, configured to store the compressed data unit in a new data group;

a third processing unit 37, configured to determine whether an unprocessed data unit is included in the original data set; when the original data group contains unprocessed data units, the first processing unit 33 is triggered to process; and when the original data group does not contain unprocessed data units, ending the process.

in one possible implementation, the first processing unit 33 is configured to analyze the selected data unit to obtain an analysis result; inquiring a preset table according to the analysis result to obtain a corresponding data type;

Wherein, the data type comprises:

a second data type consisting of a word representative and/or an array type;

a third data type consisting of a specific type.

in one possible implementation, the first processing unit 33 is configured to select the first data unit from the data units included in the original data group when the unprocessed data unit selected from the data units included in the original data group is the first selected data unit.

In a possible implementation manner, the second processing unit 35 is configured to, when the data type is the first data type, select a corresponding first preset processing manner based on the first data type to perform compression processing on the data unit, so as to obtain a corresponding data unit; the data unit compression processing module is used for selecting a corresponding second preset processing mode based on the second data type to compress the data unit to obtain a corresponding data unit when the data type is the second data type; for performing no processing when the data type is the third data type.

In one possible implementation, the second processing unit 35 is specifically configured to obtain a data length of the data unit, and determine a corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to the addition processing.

In one possible implementation, the second processing unit 35 is specifically configured to determine whether the number of data sub-units of the data unit is limited; when the number of the data subunits is limited, acquiring the data length of the data unit, and determining the corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to the addition processing.

In one possible implementation, the method further includes:

a fourth processing unit 38, configured to determine whether the data unit includes a data sub-unit; when the data units comprise data subunits, selecting one data subunit from the data subunits contained in the data units, performing table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, performing compression processing on the data subunit according to a preset processing mode corresponding to the determined data type, to obtain a compressed data subunit, and storing the compressed data subunit in the corresponding position of the data unit in the new data group.

in one possible implementation, the method further includes:

a fifth processing unit 39, configured to determine whether the data unit contains an unprocessed data sub-unit; when the data unit contains unprocessed data subunits, the fourth processing unit 38 is switched to for processing; when the data unit does not contain unprocessed data sub-units, the third processing unit is switched to 37.

referring now to FIG. 4, shown is a schematic diagram of an electronic device 400 suitable for use in implementing embodiments of the present application. The terminal device in the embodiments of the present application may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

as shown in fig. 4, electronic device 400 may include a processing device (e.g., central processing unit, graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage device 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

in particular, according to embodiments of the application, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program, when executed by the processing device 401, performs the above-described functions defined in the methods of the embodiments of the present application.

it should be noted that the computer readable medium mentioned above in the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring at least two internet protocol addresses; sending a node evaluation request comprising the at least two internet protocol addresses to node evaluation equipment, wherein the node evaluation equipment selects the internet protocol addresses from the at least two internet protocol addresses and returns the internet protocol addresses; receiving an internet protocol address returned by the node evaluation equipment; wherein the obtained internet protocol address indicates an edge node in the content distribution network.

alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a node evaluation request comprising at least two internet protocol addresses; selecting an internet protocol address from the at least two internet protocol addresses; returning the selected internet protocol address; wherein the received internet protocol address indicates an edge node in the content distribution network.

Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

the units described in the embodiments of the present application may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".

the above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the disclosure. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

The electronic device provided in the present application is applicable to any embodiment of the data processing method described above, and is not described herein again.

The present application provides a computer-readable storage medium storing computer instructions that cause a computer to execute the data processing method shown in the above-described embodiment.

the computer-readable storage medium provided in the present application is applicable to any embodiment of the data processing method on the terminal device side and the data processing method on the key device side, and details are not repeated here.

it will be understood by those within the art that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. Those skilled in the art will appreciate that the computer program instructions may be implemented by a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the aspects specified in the block or blocks of the block diagrams and/or flowchart illustrations disclosed herein.

the modules of the device can be integrated into a whole or can be separately deployed. The modules can be combined into one module, and can also be further split into a plurality of sub-modules.

Those skilled in the art will appreciate that the drawings are merely schematic representations of one preferred embodiment and that the blocks or flow diagrams in the drawings are not necessarily required to practice the present application.

those skilled in the art will appreciate that the modules in the devices in the embodiments may be distributed in the devices in the embodiments according to the description of the embodiments, and may be correspondingly changed in one or more devices different from the embodiments. The modules of the above embodiments may be combined into one module, or further split into multiple sub-modules.

The above application serial numbers are for descriptive purposes only and do not represent the merits of the embodiments.

the disclosure of the present application is only a few specific embodiments, but the present application is not limited to these, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present application.

Claims

1. A data processing method applied to a computer terminal including a processor, a memory and an input device, the method comprising the steps of:

S101, the input equipment acquires an operation instruction input by a user;

step S103, the processor selects an unprocessed data unit from the data units contained in the original data group, and performs table look-up analysis on the selected data unit to obtain the data type of the selected data unit;

step S105, the processor compresses the selected data unit according to the preset processing mode to obtain a compressed data unit;

Step S106, the memory stores the compressed data unit in a new data group;

2. the method of claim 1, wherein the processor selects an unprocessed data unit from the data units included in the raw data set, and performs a table lookup analysis on the selected data unit to obtain the data type of the selected data unit, comprising:

The processor analyzes the selected data unit to obtain an analysis result;

wherein the data types include:

A second data type consisting of a word representative and/or an array type;

a third data type consisting of a specific type.

3. the method of claim 2, wherein the processor selects the first-ranked data unit from the data units included in the original data group when the unprocessed data unit selected by the processor from the data units included in the original data group is the first-selected data unit.

4. The method of claim 2, wherein the processor performs compression processing on the selected data unit according to the preset processing mode to obtain a compressed data unit, and the method comprises:

when the data type is the third data type, no processing is performed.

5. The method of claim 4, wherein the processor selects a corresponding first preset processing mode to perform compression processing on the data unit based on the first data type to obtain a corresponding data unit, and the method comprises:

6. The method of claim 4, wherein the processor selects a corresponding second preset processing mode to perform compression processing on the data unit based on the second data type to obtain a corresponding data unit, and the method comprises:

7. the method according to any of claims 1-6, wherein after step S103, further comprising:

Step S108, the processor determines whether the data unit contains a data subunit; when the data units comprise data subunits, the processor selects one data subunit from the data subunits contained in the data units, performs table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, selects a corresponding preset processing mode based on the determined data type, compresses the data subunit according to the preset processing mode to obtain the compressed data subunit, and stores the compressed data subunit in the corresponding position of the data unit in a new data set.

8. The method of claim 7, wherein after step S108, further comprising:

step S109, the processor determines whether the data unit includes an unprocessed data sub-unit; when the data unit contains unprocessed data subunits, executing step S108; when the data unit does not include unprocessed data sub-units, go to step S107.

9. a data processing apparatus, comprising:

the second acquisition unit is used for acquiring a corresponding original data set based on an operation instruction input by a user, wherein the original data set comprises a data unit;

The second processing unit is used for compressing the selected data unit according to the preset processing mode to obtain a compressed data unit;

a third processing unit, configured to determine whether the original data group includes an unprocessed data unit; when the original data group contains unprocessed data units, triggering the first processing unit to process; and when the original data group does not contain unprocessed data units, ending the process.

10. The apparatus of claim 9, wherein the first processing unit is configured to analyze the selected data unit to obtain an analysis result; inquiring a preset table according to the analysis result to obtain a corresponding data type;

Wherein the data types include:

A second data type consisting of a word representative and/or an array type;

A third data type consisting of a specific type.

11. the apparatus of claim 10, wherein the first processing unit is configured to select a first-ranked data unit from the data units included in the original data group when the unprocessed data unit selected from the data units included in the original data group is a first-selected data unit.

12. The apparatus of claim 10,

The second processing unit is used for selecting a corresponding first preset processing mode based on the first data type to compress the data unit to obtain a corresponding data unit when the data type is the first data type; the data unit compression processing module is used for selecting a corresponding second preset processing mode to compress the data unit based on a second data type to obtain a corresponding data unit when the data type is the second data type; for performing no processing when the data type is the third data type.

13. the apparatus according to claim 12, wherein the second processing unit is specifically configured to obtain a data length of the data unit, and determine a corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to adding processing.

14. The apparatus according to claim 12, wherein the second processing unit is specifically configured to determine whether the number of data sub-units of the data unit is limited; when the number of the data subunits is limited, acquiring the data length of the data unit, and determining the corresponding data length type based on the data length; and when the data unit can be written into the corresponding byte, adding the numerical value corresponding to the determined data length type and the numerical value corresponding to the data length to obtain the data unit subjected to adding processing.

15. the apparatus of any one of claims 9-14, further comprising:

A fourth processing unit, configured to determine whether the data unit includes a data sub-unit; when the data units comprise data subunits, selecting one data subunit from the data subunits contained in the data units, performing table look-up analysis on the selected data unit to obtain the data type of the selected data subunit, selecting a corresponding preset processing mode based on the determined data type, performing compression processing on the data subunit according to the preset processing mode to obtain the compressed data subunit, and storing the compressed data subunit in the corresponding position of the data unit in a new data group.

16. The apparatus of claim 15, further comprising:

A fifth processing unit, configured to determine whether the data unit contains an unprocessed data sub-unit; when the data unit contains unprocessed data subunits, switching to the fourth processing unit for processing; and when the data unit does not contain unprocessed data subunits, switching to the third processing unit for processing.

17. an electronic device, comprising: a processor and a memory;

The memory is used for storing operation instructions;

The processor is configured to execute the data processing method according to any one of the above claims 1 to 8 by calling the operation instruction.

18. a computer-readable storage medium for storing computer instructions which, when executed on a computer, cause the computer to perform the data processing method of any one of claims 1 to 8.