CN116186036A - Data processing method and device based on Redis database and index - Google Patents

Data processing method and device based on Redis database and index Download PDF

Info

Publication number
CN116186036A
CN116186036A CN202211736711.6A CN202211736711A CN116186036A CN 116186036 A CN116186036 A CN 116186036A CN 202211736711 A CN202211736711 A CN 202211736711A CN 116186036 A CN116186036 A CN 116186036A
Authority
CN
China
Prior art keywords
target data
data
index structure
index
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211736711.6A
Other languages
Chinese (zh)
Inventor
单升起
林丹
阳万里
阳兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202211736711.6A priority Critical patent/CN116186036A/en
Publication of CN116186036A publication Critical patent/CN116186036A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0877—Cache access modes
    • G06F12/0882—Page mode
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)

Abstract

The application discloses a data processing method and device based on a Redis database and an index, wherein the method is applied to the field of big data processing and comprises the following steps: detecting whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of the target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path; if an index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in the disk according to the index structure; and positioning target data in the disk through the address, and processing the target data to obtain a processing result. According to the method and the device, the problem that the response speed of data processing is low because a large amount of time is occupied by a plurality of read-write instructions generated by interaction with a magnetic disk when a traditional relational database queries data in the related technology is solved.

Description

Data processing method and device based on Redis database and index
Technical Field
The application relates to the field of big data processing, in particular to a data processing method and device based on a Redis database and an index.
Background
At present, when a traditional relational database processes data, the data to be processed is usually searched in a local database, but because the data is searched in the local database and needs to be interacted with a magnetic disk for multiple times, multiple times of reading and writing instructions are generated, a large amount of time is occupied, the data loading time is long, and the response speed of the data processing instructions is low.
In addition to the method, the method is based on the traditional relational database, and the database is optimized and designed uniformly according to the overall requirement of the database, and customized codes are developed for the database so as to improve the response speed of the database to data processing instructions. However, in the first method, in a rich service scenario, it is difficult to ensure the probability that the data to be queried is already in the cache, and the response speed of the data processing instruction cannot be significantly improved; the second method has long research and development period and practical demonstration period, consumes a large amount of resources, and cannot be widely applied to database related services.
Aiming at the problem that the response speed of data processing is low because a large amount of time is occupied by a plurality of read-write instructions generated by interaction with a magnetic disk when a traditional relational database queries data in the related technology, no effective solution is proposed at present.
Disclosure of Invention
The main purpose of the application is to provide a data processing method and device based on a Redis database and an index, so as to solve the problem that a plurality of read-write instructions generated by interaction with a disk occupy a lot of time when a traditional relational database queries data in the related technology, so that the response speed of data processing is low.
To achieve the above object, according to one aspect of the present application, there is provided a data processing method based on a dis database and an index, the method comprising: detecting whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if the index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in a disk according to the index structure; and positioning the target data in the disk through the address, and processing the target data to obtain a processing result.
Further, if the data operation instruction is a query instruction, locating the target data in the disk through the address, and processing the target data to obtain a processing result, where the processing result includes: and positioning the target data in the disk through the address, and inquiring the target data to obtain a first inquiring result.
Further, if the data operation instruction is a query instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data in a local database; and positioning the target data in a disk according to the index structure to obtain a second query result, and adding the index structure into the Redis database.
Further, if the data operation instruction is a modification instruction, locating the target data in the disk through the address, and processing the target data to obtain a processing result, where the processing result includes: positioning the target data in the disk through the address, modifying the target data according to the modification instruction, and obtaining a first modification result; if the index structure corresponding to the target data is detected to be changed, the index structure is updated in the Redis database.
Further, if the data operation instruction is a modification instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data based on the index structure of the local database; acquiring the target data in a disk according to the index structure; and modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
Further, before the index path of the target data is confirmed in response to the data operation instruction if the data operation instruction is received, and the index structure corresponding to the target data is obtained from the Redis database according to the index path, the method further comprises: according to the data page address of the target data in the local database, configuring the data page address of the target data as a main key; configuring the index field value and the sub-page node address of the target data as primary key values according to the index field value and the sub-page node address of the target data in the local database; and configuring an index structure corresponding to the target data as the primary key and the primary key value, and storing the index structure into the Redis database.
Further, after locating the target data in the disk through the address and processing the target data to obtain a processing result, the method further includes: periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time; if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, updating the index structure of the target data in the local database into the Redis database.
To achieve the above object, according to another aspect of the present application, there is provided a data processing apparatus based on a dis database and an index, the apparatus comprising: the first detection unit is used for detecting whether a data operation instruction is received or not; the first acquisition unit is used for responding to the data operation instruction if the data operation instruction is received, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; a second obtaining unit, configured to obtain, if an index structure corresponding to the target data exists in the dis database, an address of the target data in a disk according to the index structure; and the processing unit is used for positioning the target data in the disk through the address and processing the target data to obtain a processing result.
Further, the processing unit includes: and the first acquisition subunit is used for positioning the target data in the disk through the address and inquiring the target data if the data operation instruction is an inquiry instruction to obtain a first inquiry result.
Further, the apparatus further comprises: a third obtaining unit, configured to obtain, if the data operation instruction is a query instruction and an index structure corresponding to the target data does not exist in the Redis database, an index structure corresponding to the target data in a local database; the first adding unit is used for positioning the target data in the disk according to the index structure to obtain a second query result, and adding the index structure to the Redis database.
Further, the processing unit includes: the second obtaining subunit is used for locating the target data in the disk through the address if the data operation instruction is a modification instruction, modifying the target data according to the modification instruction and obtaining a first modification result; and the updating subunit is used for updating the index structure in the Redis database if the index structure corresponding to the target data is detected to be changed.
Further, the apparatus further comprises: a fourth obtaining unit, configured to obtain, if the data operation instruction is a modification instruction and the index structure corresponding to the target data does not exist in the dis database, an index structure corresponding to the target data based on an index structure of a local database; a fifth obtaining unit, configured to obtain the target data according to the index structure in a disk; the second adding unit is used for modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure to the Redis database.
Further, the apparatus further comprises: the first configuration unit is used for responding to the data operation instruction and confirming an index path of target data if the data operation instruction is received, and the data page address of the target data is configured as a main key according to the data page address of the target data in the local database before the index structure corresponding to the target data is acquired from the Redis database according to the index path; the second configuration unit is used for configuring the index field value and the sub-page node address of the target data as main key values according to the index field value and the sub-page node address of the target data in the local database; and the storage unit is used for configuring an index structure corresponding to the target data into the primary key and the primary key value and storing the index structure into the Redis database.
Further, the apparatus further comprises: the second detection unit is used for positioning the target data in the disk through the address, processing the target data, and periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time after a processing result is obtained; and the updating unit is used for updating the index structure of the target data in the local database to the Redis database if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database.
To achieve the above object, according to one aspect of the present application, there is provided a processor for executing a program, wherein the program executes any one of the above data processing methods based on a dis database and an index.
To achieve the above object, according to one aspect of the present application, there is provided an electronic device including one or more processors and a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement any one of the above-described data processing methods based on the dis database and the index.
Through the application, the following steps are adopted: detecting whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if the index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in a disk according to the index structure; and positioning the target data in the disk through the address, and processing the target data to obtain a processing result. The method solves the problem that the response speed of data processing is low because a plurality of read-write instructions generated by interaction with a magnetic disk occupy a lot of time when the traditional relational database queries data. By acquiring the index structure corresponding to the data to be queried (namely the target data) from the Redis database, positioning the target data in the disk according to the index structure corresponding to the target data, multiple read-write interaction operations with the disk when the target data are acquired are reduced, loading of the target data in a large amount of time is avoided, and the effect of improving the response speed of data processing is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application, illustrate and explain the application and are not to be construed as limiting the application. In the drawings:
FIG. 1 is a flow chart of a Redis database and index based data processing method provided in accordance with an embodiment of the present application;
FIG. 2 is a schematic diagram I of an alternative Redis database and index-based data processing method provided in accordance with an embodiment of the present application;
FIG. 3 is a schematic diagram II of an alternative Redis database and index based data processing method provided in accordance with an embodiment of the present application;
FIG. 4 is a schematic diagram III of an alternative Redis database and index-based data processing method provided in accordance with an embodiment of the present application;
FIG. 5 is a schematic diagram IV of an alternative Redis database and index-based data processing method provided in accordance with an embodiment of the present application;
FIG. 6 is a schematic diagram of a Redis database and index based data processing apparatus provided in accordance with an embodiment of the present application;
FIG. 7 is a schematic diagram of a Redis database and index based data processing electronic device provided in accordance with an embodiment of the present application.
Detailed Description
It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other. The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate in order to describe the embodiments of the present application described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The present invention will be described with reference to preferred implementation steps, and fig. 1 is a flowchart of a data processing method based on a dis database and an index according to an embodiment of the present application, as shown in fig. 1, and the method includes the following steps:
step S101, detecting whether a data operation instruction is received.
Step S102, if a data operation instruction is received, an index path of target data is confirmed in response to the data operation instruction, and an index structure corresponding to the target data is obtained from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation.
When a data operation instruction is received, data processed by the data operation instruction (i.e., target data) needs to be acquired first, and then the target data is processed. In this embodiment, in order to obtain the target data in the database, the database optimizer needs to obtain the query path (i.e., index path) of the target data after calculation, and then query the index structure corresponding to the target data in the Redis database according to the index path.
Step S103, if an index structure corresponding to the target data exists in the Redis database, the address of the target data in the disk is obtained according to the index structure.
Step S104, positioning target data in the disk through the address, and processing the target data to obtain a processing result.
In this embodiment, if the index structure corresponding to the target data is obtained in the Redis database through the query, the specific address of the target data in the disk can be obtained from the information in the index structure, and the target data is positioned and obtained in the disk according to the address, so that multiple scanning operations and read-write operations on the disk are avoided, and the effect of reducing the response time of data processing is achieved.
In summary, according to the data processing method based on the Redis database and the index provided by the embodiment of the application, whether the data operation instruction is received or not is detected; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if an index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in the disk according to the index structure; and positioning target data in the disk through the address, and processing the target data to obtain a processing result. The method solves the problem that the response speed of data processing is low because a plurality of read-write instructions generated by interaction with a magnetic disk occupy a lot of time when the traditional relational database queries data. By acquiring the index structure corresponding to the data to be queried (namely the target data) from the Redis database, positioning the target data in the disk according to the index structure corresponding to the target data, multiple read-write interaction operations with the disk when the target data are acquired are reduced, loading of the target data in a large amount of time is avoided, and the effect of improving the response speed of data processing is achieved.
Optionally, in the data processing method based on the dis database and the index provided in the embodiment of the present application, if the data operation instruction is a query instruction, locating target data in a disk through an address, and processing the target data, a processing result includes: and positioning target data in the disk through the address, and inquiring the target data to obtain a first inquiring result.
And carrying out different processing on the data aiming at different data operation instructions, and if the computer system receives the query instruction for querying the target data, acquiring the target data (namely, a first query result) from the disk according to the address of the target data in the disk. In this embodiment, the address of the target data in the disk is obtained in the redis database, so that the target data can be directly located in the disk, a large amount of response time generated by multiple times of read-write interaction with the disk in the data processing process is avoided, and the effect of improving the response speed of data processing is further achieved.
Optionally, in the data processing method based on the dis database and the index provided in the embodiment of the present application, if the data operation instruction is a query instruction and there is no index structure corresponding to the target data in the dis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data in the local database; and positioning target data in the disk according to the index structure to obtain a second query result, and adding the index structure into the Redis database.
After the computer system receives the query instruction for querying the target data, if the index structure corresponding to the target data is not queried in the Redis database, the fact that the address of the target data in the disk can not be obtained in the Redis database is confirmed. Therefore, in order to acquire the target data, it is necessary to query the local database for the index structure of the target data, and acquire the target data (i.e., the second query result) from the disk according to the address information included in the index structure. In addition, in order to increase the response speed of the next query, it is necessary to add an index structure of the target data in the local database to the Redis database.
For example, if a query command for querying a "name" in a student table is received, firstly, querying whether an index structure corresponding to a column of the "name" in the student table exists in a Redis database, and if the index structure corresponding to the column of the "name" in the student table does not exist in the Redis database, querying the index structure corresponding to the column of the "name" in the student table in a local database to obtain an address for storing specific information of the "name" of the student in a disk, and obtaining the "name" information of the student according to the address; meanwhile, in order to improve the response speed of data processing, the information of the student's name can be obtained quickly when the next computer system receives the query command for querying the student's name list, and the index structure corresponding to the student's name list in the local database is required to be added into the redis database, so that the computer system can directly acquire the index structure corresponding to the student's name list in the redis database, and the information of the student's name is directly acquired in a disk according to the address information in the index structure, thereby avoiding the computer system from querying in the local database for multiple times.
By storing the index structure of the target data into the Redis database, the computer system can directly position the target data in the disk according to the index structure corresponding to the target data in the Redis database, thereby avoiding multiple read-write interactions with the disk and improving the response speed of the system to data processing.
Optionally, in the data processing method based on the dis database and the index provided in the embodiment of the present application, if the data operation instruction is a modification instruction, locating the target data in the disk through the address, and processing the target data, where the obtaining the processing result includes: positioning target data in the disk through the address, modifying the target data according to the modification instruction, and obtaining a first modification result; if the index structure corresponding to the target data is detected to be changed, the index structure is updated in the Redis database.
In addition to the query instruction, the data operation instruction further includes a modification instruction for modifying the target data, and if the computer system receives the modification instruction for modifying the target data, the target data is modified in the disk according to the address of the target data in the disk, so as to obtain a modification result (i.e. a first modification result). When modifying data, the index structure corresponding to the target data may be changed, so that in order to ensure that other data processing instructions for processing the target data after the modification instruction can obtain the correct index structure in the redis database, the index structure after the modification of the target data needs to be updated into the redis database.
In this embodiment, by obtaining the index structure corresponding to the target data in the redis database, the target data can be directly located and modified in the disk according to the address information in the index structure, so that a large amount of response time generated by multiple read-write interactions with the disk in the data processing process is avoided, and the effect of improving the response speed of data processing is achieved; meanwhile, the index structure corresponding to the target data of the index structure is modified by timely updating the modified instruction in the redis database, so that the accuracy of the target data obtained in the data operation instruction is ensured.
Optionally, in the data processing method based on the dis database and the index provided in the embodiment of the present application, if the data operation instruction is a modification instruction and there is no index structure corresponding to the target data in the dis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data based on the index structure of the local database; acquiring target data in a disk according to an index structure; and modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
After the computer system receives the modification instruction for modifying the target data, if the index structure corresponding to the target data is not queried in the Redis database, the fact that the address of the target data in the disk can not be obtained in the Redis database is confirmed. Therefore, in order to acquire and modify the target data, it is necessary to query the local database for the index structure of the target data, acquire the target data from the disk according to the address information in the index structure, modify the target data, and obtain the modification result (i.e., the second modification result). In addition, in order for the data processing instruction that processes the target data next time to be able to obtain the correct address of the target data in the Redis database, the index structure of the target data modified in the local database needs to be updated into the Redis database.
By storing the index structure of the updated target data into the Redis database, the computer system can directly position the target data on the disk according to the index structure corresponding to the target data in the Redis database, thereby avoiding multiple read-write interactions with the disk and improving the response speed of the system to data processing.
Optionally, in the data processing method based on the Redis database and the index provided in the embodiment of the present application, before the index path of the target data is confirmed in response to the data operation instruction if the data operation instruction is received, and the index structure corresponding to the target data is obtained from the Redis database according to the index path, the method further includes: according to the data page address of the target data in the local database, configuring the data page address of the target data as a main key; according to the index field value and the sub-page node address of the target data in the local database, configuring the index field value and the sub-page node address of the target data as main key values; and configuring an index structure corresponding to the target data as a primary key and a primary key value, and storing the index structure into a Redis database.
The index structure corresponding to the target data comprises a main key and a main key value corresponding to the target data, wherein the main key is a data page address of the target data in a disk, and the main key value is an index field value and a sub page node address of the target data. Before the index structure corresponding to the target data is queried in the redis database, the index structure corresponding to the target data needs to be added into the redis database from the local database, so that the computer system can position the target data in the disk according to the data page address, the index field value and the sub-page node address contained in the index structure corresponding to the target data.
In this embodiment, by creating an index structure corresponding to the target data and adding the index structure corresponding to the target data to the redis database, the computer system can obtain the address of the target data in the disk according to the information in the index structure in the redis database, so that multiple interactions between the computer system and the disk are avoided, and the effect of reducing the response time of data processing is achieved.
Optionally, in the data processing method based on the Redis database and the index provided in the embodiment of the present application, after locating target data in a disk through an address, and processing the target data, the method further includes: periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time; if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, the index structure of the target data in the local database is updated to the Redis database.
In order to ensure that the computer system can obtain the correct address of the target data in the Redis database, it is necessary to ensure that the index structure corresponding to the target data in the Redis database is consistent with the index structure corresponding to the target data in the local database. Therefore, in this embodiment, a thread timing detection (i.e. periodically detecting according to a preset time) is configured to determine whether the corresponding index structure of the target data in the Redis database is consistent with the corresponding index structure of the target data in the local database, and if it is detected that the corresponding index structure of the target data in the Redis database is inconsistent with the corresponding index structure of the target data in the local database, the corresponding index structure of the target data in the local database needs to be updated to the Redis database.
By setting the timing thread to detect whether the corresponding index structure of the target data in the Redis database is consistent with the corresponding index structure of the target data in the local database, the accuracy of the index structure in the Redis database is ensured, repeated query operation of a computer system caused by the wrong index structure is avoided, and the effect of improving the response speed of data processing is further achieved.
In summary, the data processing method based on the Redis database and the index provided by the embodiment of the application detects whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if an index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in the disk according to the index structure; and positioning target data in the disk through the address, and processing the target data to obtain a processing result. The method solves the problem that the response speed of data processing is low because a plurality of read-write instructions generated by interaction with a magnetic disk occupy a lot of time when the traditional relational database queries data. By acquiring the index structure corresponding to the data to be queried (namely the target data) from the Redis database, positioning the target data in the disk according to the index structure corresponding to the target data, multiple read-write interaction operations with the disk when the target data are acquired are reduced, loading of the target data in a large amount of time is avoided, and the effect of improving the response speed of data processing is achieved.
Alternatively, in this embodiment, the index structure corresponding to the target data stored in the redis database in this embodiment may be as shown in fig. 2, where col1, col2, and col3 are different column names of the tables in the database, for example, col1 may represent a column of "age" in the student table, and correspondingly, there is data of "age" of "22", "35", "12", and "5" in the student table. In fig. 2, the database stores data in a B-tree data structure, for example, two sets of data "5" and "35" are stored in page 1, the sub-page address corresponding to data "5" is page 2, the sub-page address corresponding to data "35" is page 3, the sub-page address corresponding to data "5" is page 4 in page 2, and the address corresponding to data "5" in disk is "0x77" in page 4. According to the above index structure, after the computer system obtains the index structure corresponding to the target data in the redis database, the address of the target data can be obtained according to the index structure, and the target data can be obtained in the disk according to the address.
Alternatively, in this embodiment, the process of querying the target data in response to the data operation instruction may be as shown in fig. 3, and when the computer system receives the query instruction, the index path is first confirmed by the database optimizer; then searching whether an index structure corresponding to the target data exists in a redis database (namely, a cache in fig. 3); if the index structure corresponding to the target data exists in the redis database, the index structure in the redis database is read, and the target data is obtained from the disk; if the index structure corresponding to the target data does not exist in the redis database, the index structure corresponding to the target data is read in the local database, and the index structure corresponding to the target data is updated into the redis database.
Alternatively, in this embodiment, the process of modifying the target data in response to the data operation instruction may be as shown in fig. 4, and when the computer system receives the modification instruction, the index path is first confirmed by the database optimizer; then searching whether an index structure corresponding to the target data exists in a redis database (namely, a cache in fig. 4); if the index structure corresponding to the target data exists in the redis database, the index structure in the redis database is read, and the target data is modified in a disk; if the index structure corresponding to the target data does not exist in the redis database, the index structure corresponding to the target data is read in the local database, the target data is modified, and the index structure corresponding to the target data is updated to the redis database.
Optionally, in this embodiment, the process of periodically detecting, according to a preset time, whether the index structure of the target data in the dis database is consistent with the index structure of the target data in the local database may be as shown in fig. 5, and one thread is set to compare whether the index structure of the target data in the dis database is consistent with the index structure of the target data in the local database, if it is detected that the index structure of the target data in the dis database is consistent with the index structure of the target data in the local database, then comparing again whether the index structure of the target data in the dis database is consistent with the index structure of the target data in the local database after the preset time has elapsed; if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, the index structure in the local database is updated to the Redis database.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowcharts, in some cases the steps illustrated or described may be performed in an order other than that illustrated herein.
The embodiment of the application also provides a data processing device based on the Redis database and the index, and it should be noted that the data processing device based on the Redis database and the index of the embodiment of the application can be used for executing the data processing method based on the Redis database and the index provided by the embodiment of the application. The data processing apparatus based on the Redis database and the index provided in the embodiment of the present application is described below.
FIG. 6 is a schematic diagram of a Redis database and index based data processing apparatus according to an embodiment of the present application. As shown in fig. 6, the apparatus includes: a first detection unit 601, a first acquisition unit 602, a second acquisition unit 603, and a processing unit 604.
Specifically, the first detecting unit 601 is configured to detect whether a data operation instruction is received.
The first obtaining unit 602 is configured to, if a data operation instruction is received, determine an index path of target data in response to the data operation instruction, and obtain an index structure corresponding to the target data from the Redis database according to the index path, where the target data is data of which the data operation instruction indicates an operation.
The second obtaining unit 603 is configured to obtain, if an index structure corresponding to the target data exists in the Redis database, an address of the target data in the disk according to the index structure.
And the processing unit 604 is used for positioning the target data in the disk through the address and processing the target data to obtain a processing result.
The data processing device based on the Redis database and the index provided by the embodiment of the application is used for detecting whether a data operation instruction is received or not through the first detection unit 601; the first obtaining unit 602 is configured to, if a data operation instruction is received, respond to the data operation instruction, confirm an index path of target data, and obtain an index structure corresponding to the target data from the Redis database according to the index path, where the target data is data of which the data operation instruction indicates an operation; a second obtaining unit 603, configured to obtain, if an index structure corresponding to the target data exists in the Redis database, an address of the target data in the disk according to the index structure; the processing unit 604 is configured to locate target data in the disk through the address, and process the target data to obtain a processing result, so that the problem that the response speed of data processing is low due to a large amount of time occupied by multiple read-write instructions generated by interaction with the disk when the conventional relational database queries data is solved. By acquiring the index structure corresponding to the data to be queried (namely the target data) from the Redis database, positioning the target data in the disk according to the index structure corresponding to the target data, multiple read-write interaction operations with the disk when the target data are acquired are reduced, loading of the target data in a large amount of time is avoided, and the effect of improving the response speed of data processing is achieved.
Optionally, in the data processing apparatus provided in the embodiment of the present application, the processing unit 604 includes: and the first acquisition subunit is used for positioning the target data in the disk through the address and inquiring the target data if the data operation instruction is an inquiry instruction so as to obtain a first inquiry result.
Optionally, in the data processing apparatus provided in the embodiments of the present application and based on the Redis database and the index, the apparatus further includes: the third obtaining unit is used for obtaining the index structure corresponding to the target data in the local database if the data operation instruction is a query instruction and the index structure corresponding to the target data does not exist in the Redis database; the first adding unit is used for positioning target data in the disk according to the index structure to obtain a second query result, and adding the index structure to the Redis database.
Optionally, in the data processing apparatus provided in the embodiment of the present application, the processing unit 604 includes: the second obtaining subunit is used for locating the target data in the disk through the address if the data operation instruction is a modification instruction, modifying the target data according to the modification instruction and obtaining a first modification result; and the updating subunit is used for updating the index structure in the Redis database if the index structure corresponding to the target data is detected to be changed.
Optionally, in the data processing apparatus provided in the embodiments of the present application and based on the Redis database and the index, the apparatus further includes: a fourth obtaining unit, configured to obtain, if the data operation instruction is a modification instruction and there is no index structure corresponding to the target data in the Redis database, an index structure corresponding to the target data based on the index structure of the local database; a fifth obtaining unit, configured to obtain target data in the disk according to the index structure; the second adding unit is used for modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
Optionally, in the data processing apparatus provided in the embodiments of the present application and based on the Redis database and the index, the apparatus further includes: the first configuration unit is used for responding to the data operation instruction and confirming an index path of the target data if the data operation instruction is received, and the data page address of the target data is configured as a main key according to the data page address of the target data in the local database before the index structure corresponding to the target data is acquired from the Redis database according to the index path; the second configuration unit is used for configuring the index field value and the sub-page node address of the target data as main key values according to the index field value and the sub-page node address of the target data in the local database; and the storage unit is used for configuring an index structure corresponding to the target data as a primary key and a primary key value and storing the index structure into the Redis database.
Optionally, in the data processing apparatus provided in the embodiments of the present application and based on the Redis database and the index, the apparatus further includes: the second detection unit is used for positioning target data in the disk through the address, processing the target data, and periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to the preset time after the processing result is obtained; and the updating unit is used for updating the index structure of the target data in the local database to the Redis database if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database.
The data processing device based on the dis database and the index includes a processor and a memory, where the first detecting unit 601, the first acquiring unit 602, the second acquiring unit 603, the processing unit 604, and the like are stored as program units, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The kernel can be provided with one or more than one, and the response speed of data processing is improved by adjusting the kernel parameters.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip.
The embodiment of the invention provides a computer readable storage medium, on which a program is stored, which when executed by a processor, implements a data processing method based on a Redis database and an index.
The embodiment of the invention provides a processor which is used for running a program, wherein the data processing method based on a Redis database and an index is executed when the program runs.
As shown in fig. 7, an embodiment of the present invention provides an electronic device, where the device includes a processor, a memory, and a program stored in the memory and executable on the processor, and when the processor executes the program, the following steps are implemented: detecting whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if an index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in the disk according to the index structure; and positioning target data in the disk through the address, and processing the target data to obtain a processing result.
The processor also realizes the following steps when executing the program: if the data operation instruction is a query instruction, positioning target data in the disk through the address, and processing the target data, wherein the processing result comprises: and positioning target data in the disk through the address, and inquiring the target data to obtain a first inquiring result.
The processor also realizes the following steps when executing the program: if the data operation instruction is a query instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data in the local database; and positioning target data in the disk according to the index structure to obtain a second query result, and adding the index structure into the Redis database.
The processor also realizes the following steps when executing the program: if the data operation instruction is a modification instruction, positioning target data in the disk through the address, and processing the target data, wherein the processing result comprises: positioning target data in the disk through the address, modifying the target data according to the modification instruction, and obtaining a first modification result; if the index structure corresponding to the target data is detected to be changed, the index structure is updated in the Redis database.
The processor also realizes the following steps when executing the program: if the data operation instruction is a modification instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further comprises: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data based on the index structure of the local database; acquiring target data in a disk according to an index structure; and modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
The processor also realizes the following steps when executing the program: if the data operation instruction is received, the index path of the target data is confirmed in response to the data operation instruction, and before the index structure corresponding to the target data is obtained from the Redis database according to the index path, the method further comprises: according to the data page address of the target data in the local database, configuring the data page address of the target data as a main key; according to the index field value and the sub-page node address of the target data in the local database, configuring the index field value and the sub-page node address of the target data as main key values; and configuring an index structure corresponding to the target data as a primary key and a primary key value, and storing the index structure into a Redis database.
The processor also realizes the following steps when executing the program: after locating the target data in the disk through the address and processing the target data to obtain a processing result, the method further comprises: periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time; if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, the index structure of the target data in the local database is updated to the Redis database.
The device herein may be a server, PC, PAD, cell phone, etc.
The present application also provides a computer program product adapted to perform, when executed on a data processing device, a program initialized with the method steps of: detecting whether a data operation instruction is received; if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation; if an index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in the disk according to the index structure; and positioning target data in the disk through the address, and processing the target data to obtain a processing result.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: if the data operation instruction is a query instruction, positioning target data in the disk through the address, and processing the target data, wherein the processing result comprises: and positioning target data in the disk through the address, and inquiring the target data to obtain a first inquiring result.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: if the data operation instruction is a query instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further includes: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data in the local database; and positioning target data in the disk according to the index structure to obtain a second query result, and adding the index structure into the Redis database.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: if the data operation instruction is a modification instruction, positioning target data in the disk through the address, and processing the target data, wherein the processing result comprises: positioning target data in the disk through the address, modifying the target data according to the modification instruction, and obtaining a first modification result; if the index structure corresponding to the target data is detected to be changed, the index structure is updated in the Redis database.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: if the data operation instruction is a modification instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further comprises: if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data based on the index structure of the local database; acquiring target data in a disk according to an index structure; and modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: if the data operation instruction is received, the index path of the target data is confirmed in response to the data operation instruction, and before the index structure corresponding to the target data is obtained from the Redis database according to the index path, the method further comprises: according to the data page address of the target data in the local database, configuring the data page address of the target data as a main key; according to the index field value and the sub-page node address of the target data in the local database, configuring the index field value and the sub-page node address of the target data as main key values; and configuring an index structure corresponding to the target data as a primary key and a primary key value, and storing the index structure into a Redis database.
When executed on a data processing device, is further adapted to carry out a program initialized with the method steps of: after locating the target data in the disk through the address and processing the target data to obtain a processing result, the method further comprises: periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time; if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, the index structure of the target data in the local database is updated to the Redis database.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims (10)

1. A data processing method based on a Redis database and an index, comprising:
detecting whether a data operation instruction is received;
if the data operation instruction is received, responding to the data operation instruction, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation;
if the index structure corresponding to the target data exists in the Redis database, acquiring the address of the target data in a disk according to the index structure;
and positioning the target data in the disk through the address, and processing the target data to obtain a processing result.
2. The method of claim 1, wherein if the data manipulation instruction is a query instruction, locating the target data in the disk via the address and processing the target data to obtain the processing result comprises:
and positioning the target data in the disk through the address, and inquiring the target data to obtain a first inquiring result.
3. The method of claim 1, wherein if the data manipulation instruction is a query instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further comprises:
if the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data in a local database;
and positioning the target data in a disk according to the index structure to obtain a second query result, and adding the index structure into the Redis database.
4. The method of claim 1, wherein if the data manipulation instruction is a modify instruction, locating the target data in the disk via the address and processing the target data to obtain a processing result comprises:
positioning the target data in the disk through the address, modifying the target data according to the modification instruction, and obtaining a first modification result;
if the index structure corresponding to the target data is detected to be changed, the index structure is updated in the Redis database.
5. The method of claim 1, wherein if the data manipulation instruction is a modification instruction and the index structure corresponding to the target data does not exist in the Redis database, the method further comprises:
If the index structure corresponding to the target data does not exist in the Redis database, acquiring the index structure corresponding to the target data based on the index structure of the local database;
acquiring the target data in a disk according to the index structure;
and modifying the target data according to the modification instruction to obtain a second modification result, and adding the index structure into the Redis database.
6. The method of claim 3, wherein, before validating an index path of target data in response to the data operation instruction if the data operation instruction is received, and obtaining an index structure corresponding to the target data from a dis database according to the index path, the method further comprises:
according to the data page address of the target data in the local database, configuring the data page address of the target data as a main key;
configuring the index field value and the sub-page node address of the target data as primary key values according to the index field value and the sub-page node address of the target data in the local database;
and configuring an index structure corresponding to the target data as the primary key and the primary key value, and storing the index structure into the Redis database.
7. A method according to claim 3, wherein after locating the target data in the disk by the address and processing the target data to obtain a processing result, the method further comprises:
periodically detecting whether the index structure of the target data in the Redis database is consistent with the index structure of the target data in the local database according to preset time;
if the index structure of the target data in the Redis database is detected to be inconsistent with the index structure of the target data in the local database, updating the index structure of the target data in the local database into the Redis database.
8. A data processing apparatus based on a Redis database and an index, comprising:
the first detection unit is used for detecting whether a data operation instruction is received or not;
the first acquisition unit is used for responding to the data operation instruction if the data operation instruction is received, confirming an index path of target data, and acquiring an index structure corresponding to the target data from a Redis database according to the index path, wherein the target data is data of which the data operation instruction indicates operation;
A second obtaining unit, configured to obtain, if an index structure corresponding to the target data exists in the dis database, an address of the target data in a disk according to the index structure;
and the processing unit is used for positioning the target data in the disk through the address and processing the target data to obtain a processing result.
9. A processor for running a program, wherein the program when run performs the dis database and index based data processing method of any one of claims 1 to 7.
10. An electronic device comprising one or more processors and a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the Redis database and index-based data processing method of any of claims 1-7.
CN202211736711.6A 2022-12-30 2022-12-30 Data processing method and device based on Redis database and index Pending CN116186036A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211736711.6A CN116186036A (en) 2022-12-30 2022-12-30 Data processing method and device based on Redis database and index

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211736711.6A CN116186036A (en) 2022-12-30 2022-12-30 Data processing method and device based on Redis database and index

Publications (1)

Publication Number Publication Date
CN116186036A true CN116186036A (en) 2023-05-30

Family

ID=86445426

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211736711.6A Pending CN116186036A (en) 2022-12-30 2022-12-30 Data processing method and device based on Redis database and index

Country Status (1)

Country Link
CN (1) CN116186036A (en)

Similar Documents

Publication Publication Date Title
US11288287B2 (en) Methods and apparatus to partition a database
CN112487083B (en) Data verification method and device
CN110019111B (en) Data processing method, data processing device, storage medium and processor
CN106933842B (en) Database query method and device
CN112181902A (en) Database storage method and device and electronic equipment
CN107609011B (en) Database record maintenance method and device
CN114297204A (en) Data storage and retrieval method and device for heterogeneous data source
CN108959330B (en) Database processing and data query method and device
CN108241620B (en) Query script generation method and device
CN107220265B (en) Database statement compiling and executing method and device
CN110083602B (en) Method and device for data storage and data processing based on hive table
CN111221814B (en) Method, device and equipment for constructing secondary index
CN112527792A (en) Data storage method, device, equipment and storage medium
CN116186036A (en) Data processing method and device based on Redis database and index
CN113448969B (en) Data processing method, device and storage medium
CN111125087A (en) Data storage method and device
CN110895544A (en) Interface data processing method, device, system and storage medium
CN114138745A (en) Data integration method and device, storage medium and processor
CN110019507B (en) Data synchronization method and device
CN108062329B (en) Data import method and device
CN108228604B (en) Model construction method based on memory object, information query method and device
CN113849524A (en) Data processing method and device
CN108121719B (en) Method and device for realizing data extraction conversion loading ETL
CN112948389A (en) MD 5-based database table data comparison method and equipment
CN113297317A (en) Data table synchronization method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination