CN112214503A

CN112214503A - Data processing method and device, electronic equipment and storage medium

Info

Publication number: CN112214503A
Application number: CN202011079603.7A
Authority: CN
Inventors: 曹春辉
Original assignee: OneConnect Financial Technology Co Ltd Shanghai
Current assignee: OneConnect Smart Technology Co Ltd; OneConnect Financial Technology Co Ltd Shanghai
Priority date: 2020-10-10
Filing date: 2020-10-10
Publication date: 2021-01-12

Abstract

The invention relates to the technical field of big data, and provides a data processing method, which comprises the following steps: creating a skip list, and receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time; when the deleting mode of the expired data is identified to trigger the timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list, and processing the expired data on the data of the target layer. According to the invention, the jump table is created, the expired data is determined from the last data in the target layer from back to front according to the first expiration time, whether each data is expired or not is judged one by one, and the processing efficiency of deleting the expired data is improved. In addition, the invention can also be applied to data management in a medical platform, such as deleting expired electronic medical record data and the like, so as to process medical data more efficiently.

Description

Data processing method and device, electronic equipment and storage medium

Technical Field

The invention relates to the technical field of big data, in particular to a data processing method and device, electronic equipment and a storage medium.

Background

In practical application, a large amount of data is stored in a database of the system; for some data stored in the database, the developer expects to remain in the database for only a certain period of time, and if the time for storing the data exceeds the retention time of the data, the expired data needs to be deleted.

At present, in the process of processing expired data, it is necessary to traverse the relevant information of each data in the database and determine whether each data in the database is expired one by one, so that the processing efficiency of deleting the expired data is low.

Disclosure of Invention

In view of the above, it is necessary to provide a data processing method, an apparatus, an electronic device, and a storage medium, in which a skip list is created and the last data in the target layer is traversed from back to front according to the first expiration time to determine the expiration data, so as to avoid traversing the related information of each data in the database, determine whether each data is expired one by one, and improve the processing efficiency of deleting the expiration data.

A first aspect of the present invention provides a data processing method, the method comprising:

creating a skip table from the stored plurality of data;

receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time;

identifying a deleting mode of the expired data in the data expiration processing request;

when the deleting mode of the expired data is identified to trigger a timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list;

and processing the expired data of the target layer.

Optionally, the creating a skip table according to the stored data includes:

acquiring a second expiration time of each data;

sequencing the data from late to early according to a second expiration time to obtain a data storage sequence;

and creating a multi-layer jump table according to the data storage sequence, and setting a reference expiration time for each layer of the jump table according to a preset setting mode, wherein the jump table is stored in a node of a block chain.

Optionally, the creating a multi-layer skip table according to the data storage sequence includes:

taking the data storage sequence as the lowest layer of the jump table;

determining a decreasing mode and a decreasing proportion according to the data volume of the bottommost layer;

determining the data volume of other layers of the skip list in a descending manner and in a descending proportion layer by layer in a descending manner on the basis of the data volume of the bottommost layer;

and respectively acquiring a plurality of target data from the data storage sequence according to the data quantity of other layers of the jump table and storing the target data in the corresponding layer of the jump table to obtain the jump table.

Optionally, the decrement ratio of the k-th layer of the skip list is:

wherein p represents a preset decrement coefficient; the descending mode of the k layer of the jump table is to select the first N data of the k-1 layer, wherein,

q is the amount of data at the bottom layer.

Optionally, the determining, according to the first expiration time and the reference expiration time of each layer in the skip list, a target layer corresponding to the first expiration time includes:

acquiring a first reference expiration time of each layer in the skip list and a second reference expiration time of a corresponding layer;

determining a reference expiration time range of each layer according to the first reference expiration time and the second reference expiration time of the corresponding layer;

matching the first expiration time with the reference expiration time range of each layer;

and determining a layer corresponding to the reference expiration time range successfully matched with the first expiration time as a target layer corresponding to the first expiration time.

Optionally, the processing of the expired data of the target layer includes:

traversing from the back to the front of the last data in the target layer, and judging whether the second expiration time of the traversed data is earlier than the first expiration time;

when the second expiration time of the traversed data is earlier than the first expiration time, determining the data of the second expiration time earlier than the first expiration time as first expiration data;

deleting the first stale data from the skip table.

Optionally, the method further includes:

when the deleting mode of the expired data is identified as instant access deleting expired data, acquiring a first ID of the instant access data, and matching the first ID with a second ID in the skip list;

when a second ID corresponding to the first ID is matched in the jump table, acquiring a third expiration time of the instant access data;

judging whether the third expiration time of the instant access data is earlier than the current time;

when the third expiration time of the instant access data is earlier than the current time, determining all data which are earlier than the third expiration time of the instant access data in the data corresponding to the second ID in the jump table as second expiration data;

deleting the second stale data from the skip table.

A second aspect of the present invention provides a data processing apparatus, the apparatus comprising:

a creation module for creating a jump table from the stored plurality of data;

the device comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving a data expiration processing request, and the data expiration processing request comprises first expiration time;

the identification module is used for identifying the deleting mode of the expired data in the data expiration processing request;

the determining module is used for determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list when the deleting mode of the expiration data is identified to trigger a timer to delete the expiration data;

and the processing module is used for processing the overdue data of the target layer.

A third aspect of the invention provides an electronic device comprising a processor for implementing the data processing method when executing a computer program stored in a memory.

A fourth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method.

In summary, according to the data processing method, the data processing apparatus, the electronic device, and the storage medium of the present invention, on one hand, by creating the skip list and setting the reference expiration time for each layer of the skip list, since the data in the skip list is sorted according to the expiration times and is decreased layer by layer, as long as the corresponding expiration time is found in a specific layer of the skip list, the batch expiration data can be deleted quickly, and the processing efficiency of the expiration data is improved; on the other hand, the expired data is determined by traversing from back to front from the last data in the target layer according to the first expiration time, so that the phenomenon that whether each data is expired or not is judged one by traversing the relevant information of each data in the database is avoided, and the processing efficiency of deleting the expired data is improved; and finally, determining a target layer corresponding to the first expiration time through the first expiration time and the reference expiration time of each layer in the skip list, so that the position corresponding to the first expiration time can be quickly positioned, and then the expired data can be quickly deleted, thereby avoiding the phenomenon that each data in the database needs to be traversed to position the position corresponding to the expiration time, and improving the positioning efficiency of the expired data and the processing efficiency of the expired data.

Drawings

Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention.

Fig. 2 is a structural diagram of a data processing apparatus according to a second embodiment of the present invention.

Fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.

Detailed Description

In order that the above objects, features and advantages of the present invention can be more clearly understood, a detailed description of the present invention will be given below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

Example one

In this embodiment, the data processing method may be applied to an electronic device, and for an electronic device that needs to perform data processing, the data processing function provided by the method of the present invention may be directly integrated on the electronic device, or may be run in the electronic device in the form of a Software Development Kit (SKD).

As shown in fig. 1, the data processing method specifically includes the following steps, and the order of the steps in the flowchart may be changed and some steps may be omitted according to different requirements.

In this embodiment, when data processing is performed, a server receives a data expiration processing request, where the data expiration processing request includes a first expiration time, compares the first expiration time with a second expiration time in a created skip list, determines expiration data according to a comparison result, and processes the expiration data.

S11: a skip table is created from the stored plurality of data.

In this embodiment, the skip list is used to record a data storage sequence that is sorted from back to front according to expiration time information, where the expiration time information includes, but is not limited to, expiration time, storage time, access time, and access times.

Optionally, the creating a skip table according to the stored data includes:

acquiring a second expiration time of each data;

In this embodiment, since each data in the skip list has a second expiration time recorded therein, the data storage sequence is obtained by sorting the second expiration time of each data from late to early, and a reference expiration time is set for each layer of the skip list according to a preset setting manner, specifically, the reference expiration time may be set for each layer of the skip list in advance according to the second expiration time in the skip list and a data amount corresponding to the second expiration time, for example, the reference expiration time may be set to a latest expiration time and an earliest expiration time of a last data according to an expiration time of a first data in each layer.

It is emphasized that the skip list may also be stored in a node of a block chain in order to further ensure privacy and security of the skip list.

Further, the creating a multi-layer jump table according to the data storage sequence comprises:

taking the data storage sequence as the lowest layer of the jump table;

In this embodiment, the skip list includes a plurality of layers, a bottommost layer includes a plurality of data, and the plurality of data are all data storage sequences obtained by sorting according to a second expiration time from late to early, the data volume of each subsequent layer is decreased layer by layer according to a determined decreasing manner and a determined decreasing proportion on the basis of the data volume of the bottommost layer, and a plurality of target data are respectively obtained from the data storage sequences according to the data volumes of other layers of the skip list and stored in corresponding layers of the skip list, so as to obtain the skip list.

Further, the descending proportion of the k-th layer of the skip list is:

wherein p represents a preset decrement coefficient;

the descending mode of the k layer of the jump table is to select the first N data of the k-1 layer, wherein,

q is the amount of data at the bottom layer.

Illustratively, the bottom layer includes 20 data, a second expiration time of each data is obtained, the data are sorted from late to early according to the second expiration time of each data, a decrement ratio is determined to be 1/2 according to the 20 data, the number of data of layer 3 of the skip list is 5, the first 5 data are selected from layer 2 to serve as a third layer of the skip list, and the expiration time of each data of the first 5 data is obtained, if the second expiration time of the 1 st data is 9: 05, the second expiration time of the 2 nd data is 8:59, the second expiration time of the 3 rd data is 8:59, and the second expiration time of the 4 th data is 8: 47, the second expiration time of the 5 th data is 8:25, and according to the latest expiration time 9: 05 and 8:25, determining that the reference expiration time of the third layer is 9: 05 to 8: 25.

In the embodiment, the skip list is created according to the stored data, and the reference expiration time is set for each layer of the skip list, and as the data in the skip list is sorted according to the second expiration time and is decreased gradually layer by layer, the batch expiration data can be deleted quickly as long as the corresponding second expiration time is found in a specific layer of the skip list, and the processing efficiency of the expiration data is improved.

S12: receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time.

In this embodiment, in order to ensure a sufficient memory usage space, it is necessary to delete the expired data in the memory in time, and delete all data earlier than the first expiration time according to the first expiration time in the data expiration processing request input by the user.

S13: and identifying the deleting mode of the expired data in the data expiration processing request.

In this embodiment, the deleting method of the stale data includes starting a timer to delete the stale data and instantly accessing to delete the stale data, and in response to the data stale processing request, identifying the deleting method of the stale data in the data stale processing request by using an identification technology, where the identification technology is determined according to the received request to be processed, for example, the request to be processed input by a user is a text, and identifying the deleting method of the stale data in the text by using a text identification technology; the method comprises the steps that a to-be-processed request input by a user is audio data, and a language identification technology is adopted to identify a deleting mode of expired data in the audio data.

S14: and when the deleting mode of the expired data is identified to trigger a timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list.

In this embodiment, by setting a reference expiration time for each layer, a first expiration time in the data expiration processing request may be matched with the reference expiration time of each layer in the skip list, and it is determined that the first expiration time corresponds to the target layer of the skip list according to a matching result.

In this embodiment, the first expiration time is matched with the expiration time range of the first reference expiration time of each layer in the skip list and the second reference expiration time of the corresponding layer, and the target layer corresponding to the first expiration time is determined according to the matching result.

The following are exemplary: the first reference expiration time of the first layer is: 12: 00, and the second reference expiration time is 11: 30, the reference expiration time range of the first layer is: 12: 00 to 11: 30, the first reference expiration time of the second layer is 12: 00, corresponding to a second reference expiration time of 11: 00, the reference expiration time range of the second layer is: 12: 00 to 11: 00, first expiry time 11: 22, and mixing the weight ratio of 11: 22 to 12: 00 to 11: 00, so the target horizon corresponding to the first expiration time is the second level.

In this embodiment, the target layer corresponding to the first expiration time is determined by the first expiration time and the reference expiration time of each layer in the skip list, so that the position corresponding to the first expiration time can be quickly located, and then the expiration data can be quickly deleted, thereby avoiding the phenomenon that each data in the database needs to be traversed to locate the position corresponding to the expiration time, and improving the locating efficiency of the expiration data and the processing efficiency of the expiration data.

Further, the method further comprises:

when the deleting mode of the expired data is identified as instant access deleting expired data, acquiring an ID of the instant access data, and matching the ID of the instant access data with the ID in the skip list;

when the ID of the instant access data is matched in the jump table, acquiring the expiration time of the instant access data;

judging whether the expiration time of the instant access data is earlier than the current time;

and when the expiration time of the instant access data is earlier than the current time, determining all data earlier than the expiration time of the instant access data as expired data, and deleting the expired data from the jump table.

In the embodiment, in the process of instant access of data, by judging whether the expiration time of the instant access data is earlier than the current time, the expired data can be deleted in batch according to the judgment result, and the processing efficiency of data deletion is improved.

Further, before deleting the expired data from the skip table, the method further comprises:

acquiring each expired data in the expired data, and setting an identification code, an expiration timestamp and an expiration deletion timestamp for each expired data;

and storing each overdue data, the identification code of each overdue data, the expiration timestamp and the expiration deletion timestamp into a first database.

In this embodiment, the first database may be a cache database.

Further, the method further comprises:

acquiring IDs of all expired data in the first database;

and matching the ID of each expired data with the ID in the second database, updating the states of all matched data into the expired state, and returning an updating result.

In this embodiment, the second database may be a local database, and the timeliness of updating the state of the data in the local database is improved by updating the state of the data in the local database in time.

Further, the method further comprises:

when the returned updating result is that the updating is successful, clearing all expired data in the first database; or

And when the returned updating result is updating failure, reserving all expired data in the first database.

In this embodiment, the state of the data of the corresponding ID in the second database is updated to the expired state according to the ID of each expired data, and after the update result is an update failure, all the expired data in the cache database is retained, thereby avoiding a data loss phenomenon caused by the update failure in the process of updating the state.

In this embodiment, when the returned update result is an update failure, after all the outdated data in the first database are retained, when a task is updated next time, no matter whether the outdated data is deleted by timer triggering or the outdated data is deleted by instant access, the IDs of all the outdated data in the first database are respectively matched with the ID in the second database, and the state of all the matched data is updated to the expired state and is updated to the second database, where the IDs of all the outdated data include: and after the current ID of the expired data to be updated and the ID of the expired data which is not updated successfully last time are updated successfully, the first database is emptied, so that the phenomenon that the data state in the local database is not updated timely is avoided.

S15: and processing the expired data of the target layer.

In the embodiment, the expired data is determined by traversing from back to front according to the last data in the target layer at the first expiration time, so that the phenomenon that whether each data is expired is judged one by traversing the relevant information of each data in the database is avoided, and the processing efficiency of deleting the expired data is improved.

Optionally, the processing of the expired data of the target layer includes:

deleting the first stale data from the skip table.

In the embodiment, the expired data is determined by traversing from back to front from the last data in the target layer according to the first expiration time, so that the phenomenon that whether each data is expired or not is judged one by traversing the relevant information of each data in the database is avoided, and the processing efficiency of deleting the expired data is improved.

In other embodiments, a target layer may be determined according to a difference between a reference time of each layer and the first expiration time, specifically, the target layer is not necessarily a layer where the first expiration time is located, but batch data may be quickly deleted according to an expiration result according to whether the last data of the determined target layer is expired, so that a phenomenon that information related to each data in a database is traversed, whether each data in the database is expired is determined one by one, and processing efficiency of deleting expired data is improved.

Specifically, determining a target layer corresponding to the first expiration time according to the first expiration time and a reference expiration time of each layer in the skip list includes:

acquiring a third reference expiration time and a fourth reference expiration time of a first layer in the skip list, wherein the third reference expiration time is later than the fourth reference expiration time;

acquiring a plurality of fifth reference expiration moments corresponding to other layers in the skip list, wherein the fifth reference expiration moments are later than the fourth reference expiration moments;

calculating the difference between the first expiration time and the third reference expiration time to obtain a first difference value;

calculating the difference between the first expiration time and the fourth reference expiration time to obtain a second difference value;

calculating the difference between the first expiration time and each fifth reference expiration time to obtain a plurality of third difference values;

and selecting the target layer corresponding to the minimum difference value from the first difference value, the second difference value and the third difference values, and determining the target layer corresponding to the first expiration time.

In this embodiment, after the target layer corresponding to the first expiration time is determined, by judging whether the last data of the target layer is expired or not, and deleting the batch data quickly according to the expiration result, the phenomenon that the related information of each data in the database is traversed, whether each data in the database is expired or not is judged one by one is avoided, and the processing efficiency of deleting the expired data is improved.

In summary, the data processing method according to this embodiment creates a skip table according to a plurality of stored data; receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time; identifying a deleting mode of the expired data in the data expiration processing request; when the deleting mode of the expired data is identified to trigger a timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list; and processing the expired data of the target layer.

In this embodiment, on one hand, by creating the skip list and setting the reference expiration time for each layer of the skip list, since the data in the skip list is sorted according to the expiration time and is decreased layer by layer, as long as the corresponding expiration time is found in a specific layer of the skip list, the batch expiration data can be deleted quickly, and the processing efficiency of the expiration data is improved; on the other hand, the expired data is determined by traversing from back to front from the last data in the target layer according to the first expiration time, so that the phenomenon that whether each data is expired or not is judged one by traversing the relevant information of each data in the database is avoided, and the processing efficiency of deleting the expired data is improved; and finally, determining a target layer corresponding to the first expiration time through the first expiration time and the reference expiration time of each layer in the skip list, so that the position corresponding to the first expiration time can be quickly positioned, and then the expired data can be quickly deleted, thereby avoiding the phenomenon that each data in the database needs to be traversed to position the position corresponding to the expiration time, and improving the positioning efficiency of the expired data and the processing efficiency of the expired data.

In addition, in the process of instant access data, by judging whether the third expiration time of the instant access data is greater than the current time, the expired data can be deleted in batches according to the judgment result, and the processing efficiency of data deletion is improved. It should be noted that the present invention can also be applied to data management in a medical platform, such as deleting expired electronic medical record data, etc., so as to process medical data more efficiently.

Example two

In some embodiments, the data processing apparatus 20 may comprise a plurality of functional modules comprised of program code segments. The program code of the various program segments in the data processing device 20 may be stored in a memory of the electronic device and executed by the at least one processor to perform the functions of data processing (described in detail in fig. 1).

In this embodiment, the data processing apparatus 20 may be divided into a plurality of functional modules according to the functions performed by the data processing apparatus. The functional module may include: the system comprises a creating module 201, a receiving module 202, a recognizing module 203, a determining module 204, an obtaining module 205, a judging module 206 and a processing module 207. The module referred to herein is a series of computer program segments capable of being executed by at least one processor and capable of performing a fixed function and is stored in memory. In the present embodiment, the functions of the modules will be described in detail in the following embodiments.

The creation module 201: for creating a jump table from the stored plurality of data.

Optionally, the creating module 201 creating the skip table according to the stored multiple data includes:

acquiring a second expiration time of each data;

and creating a multi-layer jump table according to the data storage sequence, and setting a reference expiration time for each layer of the jump table according to a preset setting mode, wherein the jump table is stored in a block chain node.

taking the data storage sequence as the lowest layer of the jump table;

Further, the descending scale of the k-th layer of the skip list is:

q is the amount of data at the bottom layer.

The receiving module 202: the data processing method is used for receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time.

The recognition module 203: the method is used for identifying the deleting mode of the expired data in the data expiration processing request.

The determination module 204: and when the deletion mode of the expired data is identified to trigger a timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list.

Optionally, the determining, by the determining module 204, determining, according to the first expiration time and the reference expiration time of each layer in the skip list, a target layer corresponding to the first expiration time includes:

Further, the obtaining module 205: and when the deletion mode of the expired data is identified as instant access deletion of the expired data, acquiring the ID of the instant access data, and matching the ID of the instant access data with the ID in the skip list.

The acquisition module 205: the system is also used for acquiring the expiration time of the instant access data when the ID of the instant access data is matched in the jump table;

the judging module 206: the system is used for judging whether the expiration time of the instant access data is earlier than the current time;

the determination module 204: and when the expiration time of the instant access data is earlier than the current time, determining all data earlier than the expiration time of the instant access data as expired data, and deleting the expired data from the jump table.

Further, before deleting the expired data from the skip table, the obtaining module 205: the system is also used for acquiring each expired data in the expired data, and setting an identification code, an expiration time stamp and an expiration deletion time stamp for each expired data. And storing each overdue data, the identification code of each overdue data, the expiration timestamp and the expiration deletion timestamp into a first database.

In this embodiment, the first database may be a cache database.

Further, the obtaining module 205: the ID of all expired data in the first database is also acquired; and matching the ID of each expired data with the ID in the second database, updating the states of all matched data into the expired state, and returning an updating result.

Further, when the returned updating result is that the updating is successful, all expired data in the first database is emptied; or when the returned updating result is updating failure, keeping all expired data in the first database.

The processing module 207: and the data processing device is used for processing the expired data of the target layer.

Optionally, the processing module 207, for processing the expired data of the target layer, includes:

deleting the first stale data from the skip table.

Specifically, the determining module 204 determines, according to the first expiration time and the reference expiration time of each layer in the skip list, a target layer corresponding to the first expiration time, including:

In summary, the data processing apparatus according to this embodiment creates a skip table according to a plurality of stored data; receiving a data expiration processing request, wherein the data expiration processing request comprises a first expiration time; identifying a deleting mode of the expired data in the data expiration processing request; when the deleting mode of the expired data is identified to trigger a timer to delete the expired data, determining a target layer corresponding to the first expiration time according to the first expiration time and the reference expiration time of each layer in the skip list; and processing the expired data of the target layer.

In addition, in the process of instant access data, by judging whether the third expiration time of the instant access data is greater than the current time, the expired data can be deleted in batches according to the judgment result, and the processing efficiency of data deletion is improved.

EXAMPLE III

Fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention. In the preferred embodiment of the present invention, the electronic device 3 comprises a memory 31, at least one processor 32, at least one communication bus 33 and a transceiver 34.

It will be appreciated by those skilled in the art that the configuration of the electronic device shown in fig. 3 does not constitute a limitation of the embodiment of the present invention, and may be a bus-type configuration or a star-type configuration, and the electronic device 3 may include more or less other hardware or software than those shown, or a different arrangement of components.

In some embodiments, the electronic device 3 is an electronic device capable of automatically performing numerical calculation and/or information processing according to instructions set or stored in advance, and the hardware thereof includes but is not limited to a microprocessor, an application specific integrated circuit, a programmable gate array, a digital processor, an embedded device, and the like. The electronic device 3 may also include a client device, which includes, but is not limited to, any electronic product that can interact with a client through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, a digital camera, and the like.

It should be noted that the electronic device 3 is only an example, and other existing or future electronic products, such as those that can be adapted to the present invention, should also be included in the scope of the present invention, and are included herein by reference.

In some embodiments, the memory 31 is used for storing program codes and various data, such as the data processing device 20 installed in the electronic equipment 3, and realizes high-speed and automatic access to programs or data during the operation of the electronic equipment 3. The Memory 31 includes a Read-Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an electronically Erasable rewritable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory (EEPROM)), an optical Read-Only disk (CD-ROM) or other optical disk Memory, a magnetic disk Memory, a tape Memory, or any other medium readable by a computer capable of carrying or storing data.

In some embodiments, the at least one processor 32 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The at least one processor 32 is a Control Unit (Control Unit) of the electronic device 3, connects various components of the electronic device 3 by using various interfaces and lines, and executes various functions and processes data of the electronic device 3 by running or executing programs or modules stored in the memory 31 and calling data stored in the memory 31.

In some embodiments, the at least one communication bus 33 is arranged to enable connection communication between the memory 31 and the at least one processor 32 or the like.

Although not shown, the electronic device 3 may further include a power supply (such as a battery) for supplying power to each component, and optionally, the power supply may be logically connected to the at least one processor 32 through a power management device, so as to implement functions of managing charging, discharging, and power consumption through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and the like. The electronic device 3 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.

It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.

The integrated unit implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, an electronic device, or a network device) or a processor (processor) to execute parts of the methods according to the embodiments of the present invention.

In a further embodiment, in conjunction with fig. 2, the at least one processor 32 may execute an operating device of the electronic device 3 and various installed application programs (such as the data processing device 20), program codes, and the like, for example, the above modules.

The memory 31 has program code stored therein, and the at least one processor 32 can call the program code stored in the memory 31 to perform related functions. For example, the modules illustrated in fig. 2 are program codes stored in the memory 31 and executed by the at least one processor 32, so as to realize the functions of the modules for the purpose of data processing.

In one embodiment of the invention, the memory 31 stores a plurality of instructions that are executed by the at least one processor 32 to implement the functionality of data processing.

Specifically, the at least one processor 32 may refer to the description of the relevant steps in the embodiment corresponding to fig. 1, and details are not repeated here.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.

Further, the computer-readable storage medium may be non-volatile or volatile.

Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.

The block chain referred by the application is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.

The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or that the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A method of data processing, the method comprising:

creating a skip table from the stored plurality of data;

and processing the expired data of the target layer.

2. The data processing method of claim 1, wherein creating the skip table from the stored plurality of data comprises:

acquiring a second expiration time of each data;

3. The data processing method of claim 2, wherein said creating a multi-layer skip table from said data storage sequence comprises:

taking the data storage sequence as the lowest layer of the jump table;

4. A data processing method according to claim 3, wherein the decreasing scale of the k-th layer of the skip table is:

q is the amount of data at the bottom layer.

5. The data processing method of claim 1, wherein the determining a target tier corresponding to the first expiration time based on the first expiration time and a reference expiration time for each tier in the skip list comprises:

6. The data processing method according to any one of claims 1 to 5, wherein the processing of the stale data for the data of the target tier comprises:

deleting the first stale data from the skip table.

7. A data processing method according to any one of claims 1 to 5, characterized in that the method further comprises:

deleting the second stale data from the skip table.

8. A data processing apparatus, characterized in that the apparatus comprises:

a creation module for creating a jump table from the stored plurality of data;

9. An electronic device, characterized in that the electronic device comprises a processor for implementing the data processing method of any one of claims 1 to 7 when executing a computer program stored in a memory.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 7.