CN112000648A - Data clearing method and device, computer equipment and storage medium - Google Patents
Data clearing method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN112000648A CN112000648A CN202010636675.0A CN202010636675A CN112000648A CN 112000648 A CN112000648 A CN 112000648A CN 202010636675 A CN202010636675 A CN 202010636675A CN 112000648 A CN112000648 A CN 112000648A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- piece
- data table
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Abstract
The application relates to a data clearing method, a data clearing device, computer equipment and a storage medium. The method comprises the following steps: acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared; determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to any piece of specified data; determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data; and clearing data of all target data tables in each target sub-library. According to the embodiment of the application, the data clearing processing can be rapidly and accurately carried out on the target data tables with a large number and scattered storage positions, the flow is efficient, and the user operation is simple and convenient.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data clearing method and apparatus, a computer device, and a storage medium.
Background
The storage space of the database is limited, so that data cleaning needs to be performed on the database, for example, non-business tables or junk data in the database can be cleaned, otherwise, the storage space of the database is easy to be tense, and system operation and task execution are further affected.
At present, data in a database is usually cleared manually, however, when the database stores data in a database-by-database table-splitting manner, data of one data table in the database can be split into a plurality of data tables and stored in different databases, that is, the amount of data to be deleted in a database-by-database table-splitting scene is large and storage positions are scattered, so that the existing method for clearing data manually becomes inefficient in a database-by-database table-splitting scene. In addition, the existing clearing method for multiple data tables depends very much on configuration information input by a user, and when the quantity of related databases and data tables is huge, pressure and inconvenience are caused to the user operation.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a data clearing method, a data clearing device, computer equipment and a storage medium.
The present invention provides, according to a first aspect, a method for clearing data, the method comprising, in one embodiment:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to the any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and performing data clearing on all target data tables in each target sub-library.
In one embodiment, each piece of the specific data further includes database connection information;
the determining, according to any piece of designated data, a plurality of target sub-libraries in the database corresponding to the any piece of designated data includes:
determining a plurality of initial sub-databases in a database corresponding to any piece of specified data according to database connection information included in the any piece of specified data;
and determining one or more target sub-databases in the database corresponding to any piece of specified data from the plurality of initial sub-databases according to the identifier of the data table to be cleared, which is included in any piece of specified data.
In one embodiment, the to-be-cleared data table identifier includes one or more data table identifiers;
the method further comprises the following steps: and determining one or more target data table identifications corresponding to each target sub-library according to the to-be-cleaned data table identifications included in any piece of specified data, wherein the target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
In one embodiment, the above-mentioned determining, according to any piece of specified data, a plurality of target sub-libraries in the database corresponding to the any piece of specified data; determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identifier included in any piece of specified data comprises:
establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as that of the specified data;
and respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of specified data according to the one piece of specified data and determining a plurality of target data tables in any target sub-library according to the to-be-cleaned data table identifier included in the one piece of specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
In one embodiment, the above clearing data of all target data tables in each target sub-library includes:
establishing a second thread pool corresponding to each first thread through each first thread, wherein each second thread pool comprises a plurality of second threads, and the number of the second threads in each second thread pool is the same as the number of target sub-libraries determined by the first threads corresponding to the second thread pool;
and executing data clearing operation on all target data tables in one target sub-library through one second thread respectively, wherein the target sub-libraries correspondingly processed by different second threads are different.
In one embodiment, the operation of performing data clearing on all target data tables in one target sub-library through any second thread comprises:
establishing a third thread pool corresponding to any second thread through any second thread, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any second thread;
and executing data clearing operation on all target data tables corresponding to the identification of one target data table through one third thread respectively, wherein the identification of the target data tables processed correspondingly by different third threads is different.
In one embodiment, the method further comprises the following steps: establishing a database connection pool corresponding to a target sub-library through a second thread respectively, wherein the target sub-libraries processed correspondingly by different second threads are different;
performing data cleaning on all target data tables corresponding to one target data table identifier through any third thread comprises:
acquiring a database connection corresponding to the target data table identifier;
and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
The present invention provides according to a second aspect an apparatus for clearing data, in one embodiment the apparatus comprising:
the specified data acquisition module is used for acquiring specified data of the data table, wherein the specified data of the data table comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
the target sub-library determining module is used for determining a plurality of target sub-libraries in a database corresponding to any specified data according to the specified data;
the target data table determining module is used for determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any one piece of designated data;
and the clearing module is used for clearing data of all the target data tables in each target sub-library.
The present invention provides according to a third aspect a computer apparatus for purging data, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to the any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and performing data clearing on all target data tables in each target sub-library.
The present invention provides according to a fourth aspect a computer-readable storage medium for clearing data, having stored thereon a computer program which, when executed by a processor, performs the steps of:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to the any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and performing data clearing on all target data tables in each target sub-library.
According to the data clearing method, the data clearing device, the computer equipment and the storage medium, the data table designated data containing the data table identification to be cleared is obtained, and the data table can be cleared according to the actual requirement of a user; each piece of designated data corresponds to one database, so that the operation of clearing data tables in a plurality of databases can be unified; determining a target sub-database which contains a data table to be cleared in a database corresponding to each piece of specified data according to each piece of specified data, so that the clearing of the data table on the sub-database layer of the database is realized, the sub-database which does not contain the data table to be cleared is eliminated, the redundant and miscellaneous operation is reduced, the task operation load is saved, and the whole flow time is saved; and determining a plurality of target data tables in each target sub-library according to the identification of the data table to be cleared contained in the specified data and clearing all the target data tables in each target sub-library, thereby realizing the uniform operation of clearing the plurality of data tables in the plurality of data sub-libraries. According to the embodiment of the application, the data clearing processing can be rapidly and accurately carried out on the target data tables with large quantity and scattered storage positions by combining with the actual demands of users, the efficiency is high, the automation is realized, the numerous repeated operations are avoided, and a large amount of time cost, labor cost and resource use cost are saved.
Drawings
FIG. 1-1 is a diagram of an application environment of a data purge method in one embodiment;
FIGS. 1-2 are diagrams illustrating a relationship between a database and a data sub-database, according to an embodiment;
FIGS. 1-3 are diagrams illustrating relationships between data repositories and data tables, according to an embodiment;
FIG. 2 is a flow diagram illustrating a data purge method in one embodiment;
FIG. 3 is a flowchart illustrating the target sub-library determination step in one embodiment;
FIG. 4 is a schematic flow chart diagram illustrating the steps of target banking and target data table determination in one embodiment;
FIG. 5 is a flow diagram illustrating the data purge step in one embodiment;
FIG. 6 is a flow chart illustrating a data purge step in another embodiment;
FIG. 7 is a flow chart illustrating a data purge step in yet another embodiment;
FIG. 8 is a block diagram showing the structure of a data clearing apparatus according to an embodiment;
FIG. 9 is a block diagram showing a detailed structure of the target sub-library determination module in one embodiment;
FIG. 10 is a block diagram showing a detailed structure of a purge module in one embodiment;
FIG. 11 is a diagram illustrating an internal structure of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The data clearing method provided by the embodiment of the application can be applied to a system capable of clearing data, and the system can be realized by an independent server or a server cluster consisting of a plurality of servers, and can also be realized by other network side equipment. For example, as shown in fig. 1-1, the system may be implemented by a server 102, where the server 102 may interact with one or more database servers. Taking the database 110 configured in the database server 104 as an example, as shown in fig. 1-2, the database 110 may include a plurality of data sub-databases, among which there are a data sub-database 112, a data sub-database 114 and a data sub-database 116. Each data sub-library may also include a plurality of data tables, and as shown in fig. 1-3, the data sub-library 112 includes a plurality of data tables, such as a data table 120, a data table 122, and a data table 124.
In one embodiment, as shown in fig. 2, the present application provides a data purging method, comprising the steps of:
step 202: acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared.
The specified data of the data table can be input by a user, the database corresponding to each specified data is the database which needs to be cleared by the specified data, the identifier of the data table to be cleared is used for determining the data table which needs to be cleared, the identifier of the data table to be cleared can include partial information (such as prefix of the name of the data table) of one or more data table names, for example, two data tables are custlevel _ a and custlevel _ B, and if the identifier of the data table to be cleared is custlevel, the system can find the custlevel _ a and custlevel _ B based on the identifier.
Specifically, in one embodiment, the data table specifying data may be stored in an EXCEL file, and the system reads the EXCEL file to obtain the data table specifying data. Illustratively, the contents in the data table designation data may be configured as shown in table one below. The data Table identifier to be cleared in each piece of designated data is parameter information of a "Table" field in the Table, such as Table1, Table _ 2.
Table one:
| IP | Port | Username | Password | Table |
| x.x.x.1 | 10 | name_1 | word_1 | table1,table_2 |
| x.x.x.2 | 20 | name_2 | word_1 | table1,table_1 |
| x.x.x.2 | 30 | name_2 | word_2 | table2,table_3 |
in another embodiment, after the system reads the data specified by the data table, the data information can be encapsulated into an object for the system to call in the later execution process.
Specifically, the databases corresponding to different specified data are respectively deployed in different database servers, and may also be deployed in the same database server.
Step 204: and determining a plurality of target sub-databases in the database corresponding to any piece of specified data according to any piece of specified data.
Wherein, the target sub-library is a data sub-library containing a data table needing to be cleared.
Specifically, the system may select one piece of specified data from the obtained one or more pieces of specified data, access the database corresponding to the piece of specified information through information in the piece of specified data, and determine the target sub-library including the data table to be cleared in the database.
Step 206: and determining a plurality of target data tables in each target sub-library according to the identification of the data table to be cleared included in any piece of specified data.
Wherein the target data table is a data table that needs to be cleared.
Specifically, the system queries in the database corresponding to the specified data according to the identifier of the data table to be cleared, and obtains all target data tables to be cleared in each target sub-database in the database.
Step 208: and performing data clearing on all target data tables in each target sub-library.
Specifically, after determining the target data table in each target sub-library, the system clears all the target data tables in each target sub-library. The system may clear all data in the target data table and reserve the target data table, or the system may delete the target data table directly.
In the embodiment, the data table specified data containing the data table identification to be cleared is obtained, and the data table can be cleared according to the actual requirement of a user; each piece of designated data corresponds to one database, so that the operation of clearing data tables in a plurality of databases can be unified; determining a target sub-database which contains a data table to be cleared in a database corresponding to each piece of specified data according to each piece of specified data, so that the clearing of the data table on the sub-database layer of the database is realized, the sub-database which does not contain the data table to be cleared is eliminated, the redundant and miscellaneous operation is reduced, the task operation load is saved, and the whole flow time is saved; and determining a plurality of target data tables in each target sub-library according to the identification of the data table to be cleared contained in the specified data and clearing all the target data tables in each target sub-library, thereby realizing the uniform operation of clearing the plurality of data tables in the plurality of data sub-libraries. The embodiment of the application can realize clearing of a plurality of data tables in a plurality of databases and a plurality of data sub-databases by combining with actual requirements of users, is efficient and automatic, avoids various repeated operations, and saves a large amount of time cost, labor cost and resource use cost.
In one embodiment, as shown in fig. 3, each piece of the above-mentioned specified data further includes database connection information; the determining, according to any piece of designated data, a plurality of target sub-libraries in the database corresponding to the any piece of designated data includes:
step 302: and determining a plurality of initial sub-databases in the database corresponding to any piece of specified data according to the database connection information included in the any piece of specified data.
In one embodiment, the database connection information may include an IP address and port information of a server where the database is located, and the database connection information may further include a user name and a password for logging in the database.
Specifically, the system may access the database according to the database connection information, acquire all the data sublibrary lists in the database, and determine, by the exclusion part, a data sublibrary that does not include the data table to be cleared, thereby obtaining a plurality of initial sublibraries. For example, taking the database as a mysql database as an example for explanation, the system may log in an information _ schema database of the database according to the database connection information, and then execute a show databases statement, thereby obtaining a list of all the databases in the database within the current user permission range, and the system further excludes the databases (performance _ schema database, etc.) carried by the mysql database, thereby obtaining a plurality of initial databases.
Step 304: and determining one or more target sub-databases in the database corresponding to any piece of specified data from the plurality of initial sub-databases according to the identifier of the data table to be cleared, which is included in any piece of specified data.
Specifically, after determining a plurality of initial sub-databases in the database corresponding to the piece of designated data, the system further determines one or more target sub-databases containing the data table to be cleared from the plurality of databases according to the data table to be cleared identifier. For example, the system may query the to-be-cleared data table in the database according to the to-be-cleared data table identifier, and the data sub-database containing the to-be-cleared data table may be determined as the target sub-database.
In the embodiment, the system firstly excludes the data subbase which can determine that the data table to be cleared is not included by accessing the database in the execution process, so that the operation steps and the operation burden are saved for the subsequent process, and the overall process efficiency is improved.
In one embodiment, the to-be-cleared data table identifier includes one or more data table identifiers; the method also comprises the following steps: and determining one or more target data table identifications corresponding to each target sub-library according to the to-be-cleaned data table identifications included in any piece of specified data, wherein the target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
The data table identification to be cleared is one or more data table identifications, each data table identification corresponds to one or more data tables to be cleared, the target data table identification corresponding to each target sub-library is one or more data table identifications in the data table identification to be cleared, each target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library, and each target data table is uniquely corresponding to one target data table identification.
Specifically, the system checks the database according to the identifier of the data table to be cleared, and for each sub-database, the set formed by the identifiers of the data tables corresponding to all the target data tables in the sub-database is the identifier of the target data table corresponding to the target sub-database.
In this embodiment, each data table to be cleared corresponds to one data table identifier, so that the operation process of positioning the data table to be cleared is convenient and quick, all target data table identifiers in each target sub-library are determined, the data table is cleared conveniently and subsequently, and the whole data clearing process is efficient.
In one embodiment, as shown in fig. 4, the above-mentioned determining, according to any one piece of specified data, a plurality of target sub-libraries in the database corresponding to the any one piece of specified data; determining a plurality of target data tables in any target sub-library according to the to-be-cleared data table identification included in any piece of specified data comprises:
step 402, establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as the number of the specified data;
the number of threads in the first thread pool is the same as the number of the designated data, and one first thread correspondingly processes one piece of designated data, namely one first thread correspondingly processes the database corresponding to the piece of designated data. In one embodiment, the number of the designated data is two, and two databases corresponding to the two designated data are distributed in different servers as an example for explanation: such as: the two databases are in server 10.10.10.1 and server 10.10.10.2, respectively, then the database in server 10.10.10.1 may correspond to the first thread _1 and the database in server 10.10.10.2 may correspond to the thread _ 2. The first thread pool may be a cacheable thread pool, i.e., the size of the first thread pool varies with the amount of specified data. For example, if there are two pieces of specified data corresponding to two different databases, there are two threads in the first thread pool; if the number of the designated data is three, corresponding to three different databases, there are three first threads in the first thread pool.
Specifically, the system creates a first thread pool in the database embodiment layer in the main thread, and each first thread in the first thread pool correspondingly processes a database corresponding to a piece of specified data.
And 404, respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of specified data according to the one piece of specified data and determining a plurality of target data tables in any target sub-library according to the to-be-cleaned data table identifier included in the one piece of specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
Specifically, the system executes, by each first thread, to the database corresponding to the first thread: and determining a plurality of target sub-libraries in a database corresponding to one piece of specified data according to the one piece of specified data, and determining a plurality of target data tables in each target sub-library according to the to-be-cleaned data table identifier included in any one piece of specified data. For example, a mysql database in the first thread mapping server 10.10.10.1 is taken as an example for explanation: the database corresponds to the first thread 1 in the first thread pool _1, the system can log in an information _ schema library of the database through the thread _1, execute the show databases, and then exclude the self-contained data sub-library of the mysql type database to obtain a plurality of target sub-libraries of the database, such as DB _1, DB _2, DB _3, and the like. Then, the system can search in the database according to the to-be-cleared data table identifier through the thread _1 to obtain the specific table name of the target data table in each target sublibrary, for example, taking the to-be-cleared data table identifier as a data table name prefix custlevel as an example, the target data table in the sublibrary DB _1 may be custlevel _001-custlevel _ 100; the target data table in the sub-library DB _2 can be custlevel _101-custlevel _ 200.
In this embodiment, each database to be processed corresponds to one first thread, and each thread can be executed concurrently, so that data removal in a plurality of different databases is performed synchronously, a data removal process is fast and efficient, system resources are effectively and reasonably utilized, and overall processing performance is improved.
In one embodiment, as shown in fig. 5, the above-mentioned data clearing for all target data tables in each target sub-library includes:
step 502: establishing a second thread pool corresponding to each first thread through each first thread, wherein each second thread pool comprises a plurality of second threads, and the number of the second threads in each second thread pool is the same as the number of target sub-libraries determined by the first threads corresponding to the second thread pool;
step 504: and executing data clearing operation on all target data tables in one target sub-library through one second thread respectively, wherein the target sub-libraries correspondingly processed by different second threads are different.
Specifically, the system establishes a second thread pool corresponding to each first thread, that is, a database corresponding to each specified data, and establishes a second thread pool, that is, a second thread pool corresponding to each database to be processed. The number of the second threads in each second thread pool is the same as the number of the target sub-banks in the database corresponding to the second threads, one second thread corresponds to one target sub-bank, and the target sub-banks corresponding to each second thread are different. The system executes the clearing operation of the target data table in the target sub-library corresponding to the second thread through the second thread. For example, a mysql database in the first thread corresponding server 10.10.10.1 is taken as an example, the database corresponds to the first thread _1 in the first thread pool _1, the database includes the target sub-pools DB _1 and DB _2, the system establishes the second thread pool _2 corresponding to the first thread pool _1 through the thread _1, each target sub-pool in the database corresponds to one second thread in the pool _2, for example, DB _1 corresponds to the second thread _3, DB _2 corresponds to the second thread _4, the system clears all target data tables in the target sub-pool DB _1 through the thread _3, and clears all target data tables in the target sub-pool DB _2 through the thread _ 4.
In this embodiment, the thread pool of the sub-library layer is established on the basis of the thread pool of the database layer, and each target sub-library is allocated to one second thread in the second thread pool for data clearing, so that the concurrent clearing operation of a plurality of sub-library data in a plurality of databases is realized, the data clearing process is fast and efficient, the system resources are effectively and reasonably utilized, and the overall processing performance is improved.
In an embodiment, the above-mentioned operation of performing data clearing on all target data tables in one target sub-library by any second thread, as shown in fig. 6, includes:
step 602: and establishing a third thread pool corresponding to any second thread through any second thread, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any second thread.
Step 604: and executing data clearing operation on all target data tables corresponding to the identification of one target data table through one third thread respectively, wherein the identification of the target data tables processed correspondingly by different third threads is different.
Specifically, the system establishes a third thread pool corresponding to any second thread through the second thread, that is, each target sub-bank corresponds to a third thread pool. As described above, each target sub-library corresponds to one or more target data table identifiers, the number of third threads in the third thread pool corresponding to the target sub-library is the same as the number of target data table identifiers corresponding to the target sub-library, and one target data table identifier corresponds to one third thread in the third thread pool. The system respectively executes the data clearing operation on all target data tables corresponding to the target data table identification through a third thread. In one embodiment, a target sub-library is exemplified as DB _1, a second thread corresponding to the target sub-library is thread _3, and the target sub-library corresponds to two target data table identifiers: the system comprises custlevel and deptlevel, wherein a target data table in a target sub-library corresponding to the custlevel is custlevel _001-custlevel _100, and a target data table in a target sub-library corresponding to the deptlevel is deptlevel _001-deptlevel _ 100; the system establishes a third thread pool _ subDB _1 corresponding to the target sub-library through thread _3, and two third threads, namely thread _ subDB _1 and thread _ subDB _2, are arranged in the third thread pool _ subDB _1 and respectively correspond to the target data table identifications custlevel and deptlevel; the system clears the target data table custlevel _001-custlevel _100 in the target sub-library through the third thread _ subDB _1, and clears the target data table deptlevel _001-deptlevel _100 in the target sub-library through the third thread _ subDB _ 2.
In this embodiment, the third thread pool of the data table identification layer is established based on the thread pool of the database layer and the thread pools of the sub-database layers, so that a multi-thread system with three layers is established, each target data table identification is allocated to one third thread in the third thread pool for data clearing, the concurrent data clearing operation of a plurality of data tables in a plurality of sub-databases in the plurality of databases is realized, the data clearing process is fast and efficient, the system resources are effectively and reasonably utilized, and the overall processing performance is improved.
In one embodiment, the method further comprises:
and respectively establishing a database connection pool corresponding to the target sub-library through a second thread, wherein the target sub-libraries correspondingly processed by different second threads are different.
Specifically, taking an example that a target sub-library is DB _1, a second thread corresponding to the target sub-library is thread _3, and the system creates a database connection pool DB _ pool _1 corresponding to the target sub-library DB _1 through thread _3, where the database connection pool is responsible for allocating, managing, and releasing database connections of DB _ 1. In one embodiment, the database connection pool may be a dbcp (database connection pool) database connection pool. In another embodiment, the system may set parameters such as initial connection number, maximum connection number, minimum idle connection number, maximum waiting time for acquiring connection, etc. when creating the database connection pool, for example, the maximum connection number may be set to 50.
In one embodiment, as shown in fig. 7, the data clearing, by any one of the third threads, all the target data tables corresponding to one target data table identification includes:
step 702: and acquiring the database connection corresponding to the target data table identification.
Specifically, the system obtains, through the third thread, a database connection of the target sub-library corresponding to the target data table identifier, where the database connection may be from a database connection pool corresponding to the target sub-library.
Step 704: and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
Specifically, the system may access the target sub-library through the third thread according to the database connection, and then execute a clear statement according to the specific target data table name. For example, a target data table identifier is taken as the custlevel corresponding to the target sub-library DB _1 for explanation, the target data table identifier custlevel corresponds to the third thread _ subDB _1, and the target data table identifier custlevel corresponds to the custlevel _001-custlevel _100 in the target sub-library DB _ 1; the system acquires the database connection corresponding to the target sub-database DB _1 according to the third thread _ sub DB _1, accesses the target sub-database DB _1 according to the database connection, and then clears the target data table custlevel _001-custlevel _100 in sequence.
In this embodiment, a database connection pool is created corresponding to each target sub-library, which not only plays a role in protecting the target sub-libraries, so that the connection number applied to the target sub-libraries is always smaller than the maximum connection number provided by the target sub-libraries to the outside, but also supports multiplexing of database connections and reduces resource consumption. Meanwhile, reasonable allocation of resources and efficient execution of tasks can be achieved under the condition that the number of the target data tables is large.
It should be understood that although the various steps in the flow charts of fig. 2-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-7 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 8, there is provided a data clearing apparatus including: the system comprises a designated data acquisition module, a target database dividing determination module, a target data table determination module and a clearing module, wherein:
a designated data obtaining module 802, configured to obtain designated data of a data table, where the designated data of the data table includes one or more pieces of designated data, each piece of designated data corresponds to one database, and each piece of designated data includes an identifier of the data table to be cleared;
a target sub-library determining module 804, configured to determine, according to any piece of specified data, a plurality of target sub-libraries in a database corresponding to the any piece of specified data;
a target data table determining module 806, configured to determine multiple target data tables in each target sub-library according to the to-be-cleared data table identifier included in any piece of specified data;
and a clearing module 808, configured to clear data of all target data tables in each target sub-library.
In one embodiment, each piece of the specific data further includes database connection information; the target sub-base determining module 804, as shown in fig. 9, may include:
a first determining unit 902, configured to determine, according to database connection information included in any piece of specified data, a plurality of initial sub-databases in a database corresponding to the any piece of specified data;
a second determining unit 904, configured to determine, from the multiple initial sub-banks, one or more target sub-banks in the database corresponding to the any piece of specified data according to the to-be-cleared data table identifier included in the any piece of specified data.
In one embodiment, the to-be-cleared data table identifier includes one or more data table identifiers; this device still includes:
and a target data table identifier determining unit (not shown in the figure) configured to determine, according to the to-be-cleared data table identifier included in the any piece of designated data, one or more target data table identifiers corresponding to each target sub-library, where the target data table identifier corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
In an embodiment, when the target sub-repository determining module 804 and the target data table determining module 806 implement their corresponding functions, they specifically implement:
establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as that of the specified data;
and respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of specified data according to the one piece of specified data and determining a plurality of target data tables in any target sub-library according to the to-be-cleaned data table identifier included in the one piece of specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
In one embodiment, as shown in fig. 10, the clearing module 808 may include:
an establishing unit 1002, configured to establish, by each first thread, a second thread pool corresponding to the first thread, where each second thread pool includes a plurality of second threads, and the number of the second threads included in each second thread pool is the same as the number of the target sub-pools determined by the first thread corresponding to the second thread pool;
the clearing unit 1004 is configured to perform data clearing operations on all target data tables in one target sub-bank through one second thread, where the target sub-banks processed by different second threads are different.
In an embodiment, when the first clearing unit 1004 performs an operation of clearing data of all target data tables in one target sub-library through any one second thread, the following specific implementation is performed:
establishing a third thread pool corresponding to any second thread through any second thread, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any second thread;
and executing data clearing operation on all target data tables corresponding to the identification of one target data table through one third thread respectively, wherein the identification of the target data tables processed correspondingly by different third threads is different.
In one embodiment, the apparatus further comprises:
a database connection pool establishing module (not shown in the figure) for establishing a database connection pool corresponding to a target sub-pool through a second thread, wherein the target sub-pools correspondingly processed by different second threads are different.
In an embodiment, when the first clearing unit 1004 performs data clearing on all target data tables corresponding to one target data table identifier through any one third thread, the following steps are specifically performed:
acquiring a database connection corresponding to the target data table identifier;
and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
For the specific definition of the data clearing device, reference may be made to the above definition of the data clearing method, which is not described herein again. The modules in the data clearing device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 11. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is for storing data purge data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data purge method.
Those skilled in the art will appreciate that the architecture shown in fig. 11 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to the any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and performing data clearing on all target data tables in each target sub-library.
In an embodiment, each piece of the specified data further includes database connection information, and the processor executes the computer program to implement the following steps when determining, according to any piece of the specified data, a plurality of target sub-libraries in the database corresponding to the any piece of the specified data: determining a plurality of initial sub-databases in a database corresponding to any piece of specified data according to database connection information included in the any piece of specified data; and determining one or more target sub-databases in the database corresponding to any piece of specified data from the plurality of initial sub-databases according to the identifier of the data table to be cleared, which is included in any piece of specified data.
In one embodiment, the identifier of the data table to be cleared includes one or more identifiers of the data table, and the processor executes the computer program to further implement the following steps: and determining one or more target data table identifications corresponding to each target sub-library according to the to-be-cleaned data table identifications included in any piece of specified data, wherein the target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
In one embodiment, the processor executes the computer program to implement the above-mentioned determining, according to any one piece of specified data, a plurality of target sub-libraries in the database corresponding to the any one piece of specified data; when a plurality of target data tables in each target sub-library are determined according to the to-be-cleared data table identifier included in any one piece of specified data, the following steps are further specifically realized: establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as that of the specified data; and respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of specified data according to the one piece of specified data and determining a plurality of target data tables in any target sub-library according to the to-be-cleaned data table identifier included in the one piece of specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
In one embodiment, the processor executes the computer program to perform the following steps when performing data cleaning on all target data tables in each target sub-library: establishing a second thread pool corresponding to each first thread through each first thread, wherein each second thread pool comprises a plurality of second threads, and the number of the second threads in each second thread pool is the same as the number of target sub-libraries determined by the first threads corresponding to the second thread pool; and executing data clearing operation on all target data tables in one target sub-library through one second thread respectively, wherein the target sub-libraries correspondingly processed by different second threads are different.
In one embodiment, the following steps are further specifically implemented when the processor executes the computer program to perform the operation of clearing data of all target data tables in one target sub-library through any one second thread: establishing a third thread pool corresponding to any second thread through any second thread, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any second thread; and executing data clearing operation on all target data tables corresponding to the identification of one target data table through one third thread respectively, wherein the identification of the target data tables processed correspondingly by different third threads is different.
In one embodiment, the processor, when executing the computer program, further performs the steps of: and respectively establishing a database connection pool corresponding to the target sub-library through a second thread, wherein the target sub-libraries correspondingly processed by different second threads are different.
In one embodiment, the following steps are further specifically implemented when the processor executes the computer program to clear data of all target data tables corresponding to one target data table identifier through any one third thread: acquiring a database connection corresponding to the target data table identifier; and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to the any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and performing data clearing on all target data tables in each target sub-library.
In an embodiment, each piece of the specification data further includes database connection information, and the computer program when executed by the processor to determine, according to any one piece of the specification data, a plurality of target sub-libraries in the database corresponding to the any one piece of the specification data further implements the following steps: determining a plurality of initial sub-databases in a database corresponding to any piece of specified data according to database connection information included in the any piece of specified data; and determining one or more target sub-databases in the database corresponding to any piece of specified data from the plurality of initial sub-databases according to the identifier of the data table to be cleared, which is included in any piece of specified data.
In one embodiment, the identifier of the data table to be cleared includes one or more identifiers of the data table, and the computer program when executed by the processor further implements the following steps: and determining one or more target data table identifications corresponding to each target sub-library according to the to-be-cleaned data table identifications included in any piece of specified data, wherein the target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
In one embodiment, the computer program is executed by the processor to determine a plurality of target sub-libraries in the database corresponding to any one piece of specified data according to any one piece of specified data; when a plurality of target data tables in each target sub-library are determined according to the to-be-cleared data table identification included in any one piece of specified data, the following steps are also realized: establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as that of the specified data; and respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of specified data according to the one piece of specified data and determining a plurality of target data tables in any target sub-library according to the to-be-cleaned data table identifier included in the one piece of specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
In one embodiment, the computer program when executed by the processor performs the above-mentioned data cleaning for all target data tables in each target sub-library further implements the following steps: establishing a second thread pool corresponding to each first thread through each first thread, wherein each second thread pool comprises a plurality of second threads, and the number of the second threads in each second thread pool is the same as the number of target sub-libraries determined by the first threads corresponding to the second thread pool; and executing data clearing operation on all target data tables in one target sub-library through one second thread respectively, wherein the target sub-libraries correspondingly processed by different second threads are different.
In one embodiment, the computer program further implements the following steps when executed by the processor to perform the data clearing operation on all target data tables in one target sub-library through any one of the second threads: establishing a third thread pool corresponding to any second thread through any second thread, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any second thread; and executing data clearing operation on all target data tables corresponding to the identification of one target data table through one third thread respectively, wherein the identification of the target data tables processed correspondingly by different third threads is different.
In one embodiment, the computer program when executed by the processor further performs the steps of: and respectively establishing a database connection pool corresponding to the target sub-library through a second thread, wherein the target sub-libraries correspondingly processed by different second threads are different.
In one embodiment, the computer program further implements the following steps when the processor performs data clearing on all target data tables corresponding to one target data table identification through any third thread: acquiring a database connection corresponding to the target data table identifier; and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method of data purging, the method comprising:
acquiring data table specified data, wherein the data table specified data comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a data table identifier to be cleared;
determining a plurality of target sub-databases in a database corresponding to any piece of specified data according to any piece of specified data;
determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identification included in any piece of specified data;
and clearing data of all target data tables in each target sub-library.
2. The method according to claim 1, wherein each of the specified data further includes database connection information;
the determining, according to any one of the pieces of the designated data, a plurality of target sub-libraries in a database corresponding to the any one of the pieces of the designated data includes:
determining a plurality of initial sub-databases in a database corresponding to any piece of specified data according to database connection information included in the any piece of specified data;
and determining one or more target sub-databases in the database corresponding to any piece of the specified data from the plurality of initial sub-databases according to the identifier of the data table to be cleared, which is included in any piece of the specified data.
3. The method of claim 1, wherein the to-be-purged data table identification comprises one or more data table identifications;
the method further comprises the following steps:
and determining one or more target data table identifications corresponding to each target sub-library according to the to-be-cleaned data table identifications included in any piece of the designated data, wherein the target data table identification corresponding to each target sub-library corresponds to one or more target data tables in the target sub-library.
4. The method according to claim 3, wherein a plurality of target sub-libraries in the database corresponding to any one piece of the specified data are determined according to the any one piece of the specified data; determining a plurality of target data tables in any target sub-library according to the to-be-cleared data table identifier included in any piece of specified data comprises:
establishing a first thread pool, wherein the first thread pool comprises one or more first threads, and the number of the first threads is the same as that of the specified data;
and respectively executing the operation of determining a plurality of target sub-libraries in the database corresponding to one piece of the specified data according to one piece of the specified data and determining a plurality of target data tables in any one of the target sub-libraries according to the to-be-cleared data table identifier included in the one piece of the specified data through one first thread, wherein the specified data processed correspondingly by different first threads are different.
5. The method of claim 4,
the data clearing for all the target data tables in each target sub-library comprises:
establishing a second thread pool corresponding to each first thread through each first thread, wherein each second thread pool comprises a plurality of second threads, and the number of the second threads in each second thread pool is the same as the number of target sub-libraries determined by the first threads corresponding to each second thread pool;
and executing data clearing operation on all target data tables in one target sub-library through one second thread respectively, wherein the target sub-libraries correspondingly processed by different second threads are different.
6. The method of claim 5,
performing, by any of the second threads, an operation of clearing data from all target data tables in one of the target sub-pools, including:
establishing a third thread pool corresponding to any one of the second threads through any one of the second threads, wherein the third thread pool comprises one or more third threads, and the number of the third threads is the same as that of the target data table identifications corresponding to the target sub-libraries correspondingly processed by any one of the second threads;
and executing data clearing operation on all target data tables corresponding to one target data table identifier through one third thread respectively, wherein the target data table identifiers processed by different third threads are different.
7. The method of claim 6, further comprising:
establishing a database connection pool corresponding to the target sub-library through one second thread respectively, wherein the target sub-libraries processed correspondingly by different second threads are different;
performing data cleaning on all target data tables corresponding to a target data table identifier through a third thread includes:
acquiring a database connection corresponding to the target data table identifier;
and clearing data of all target data tables corresponding to the target data table identification according to the database connection corresponding to the target data table identification.
8. A data purge apparatus, the apparatus comprising:
the system comprises a specified data acquisition module, a data table processing module and a data clearing module, wherein the specified data acquisition module is used for acquiring specified data of a data table, the specified data of the data table comprises one or more pieces of specified data, each piece of specified data corresponds to one database, and each piece of specified data comprises a to-be-cleared data table identifier;
the target sub-library determining module is used for determining a plurality of target sub-libraries in a database corresponding to any piece of specified data according to any piece of specified data;
the target data table determining module is used for determining a plurality of target data tables in each target sub-library according to the to-be-cleared data table identifier included in any one piece of specified data;
and the clearing module is used for clearing data of all the target data tables in each target sub-library.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the computer program is executed by the processor.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010636675.0A CN112000648B (en) | 2020-07-03 | 2020-07-03 | Data clearing method and device, computer equipment and storage medium |
| PCT/CN2021/099673 WO2022001627A1 (en) | 2020-07-03 | 2021-06-11 | Data clearing method and apparatus, computer device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010636675.0A CN112000648B (en) | 2020-07-03 | 2020-07-03 | Data clearing method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112000648A true CN112000648A (en) | 2020-11-27 |
| CN112000648B CN112000648B (en) | 2022-11-15 |
Family
ID=73466394
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010636675.0A Active CN112000648B (en) | 2020-07-03 | 2020-07-03 | Data clearing method and device, computer equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112000648B (en) |
| WO (1) | WO2022001627A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022001627A1 (en) * | 2020-07-03 | 2022-01-06 | 苏宁易购集团股份有限公司 | Data clearing method and apparatus, computer device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095878A (en) * | 2016-06-07 | 2016-11-09 | 中国建设银行股份有限公司 | The database manipulation device and method of table is divided based on point storehouse |
| US20180067972A1 (en) * | 2016-09-07 | 2018-03-08 | International Business Machines Corporation | Automatically setting an auto-purge value to multiple tables within a database |
| CN111339088A (en) * | 2020-02-21 | 2020-06-26 | 苏宁云计算有限公司 | Database division and table division method, device, medium and computer equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9218371B2 (en) * | 2012-02-29 | 2015-12-22 | International Business Machines Corporation | Automatic table cleanup for relational databases |
| CN106528840A (en) * | 2016-11-11 | 2017-03-22 | 中国银行股份有限公司 | Service data clearing method and system based on banking system |
| CN109885565B (en) * | 2019-02-14 | 2021-05-25 | 中国银行股份有限公司 | Data table cleaning method and device |
| CN112000648B (en) * | 2020-07-03 | 2022-11-15 | 苏宁云计算有限公司 | Data clearing method and device, computer equipment and storage medium |
-
2020
- 2020-07-03 CN CN202010636675.0A patent/CN112000648B/en active Active
-
2021
- 2021-06-11 WO PCT/CN2021/099673 patent/WO2022001627A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095878A (en) * | 2016-06-07 | 2016-11-09 | 中国建设银行股份有限公司 | The database manipulation device and method of table is divided based on point storehouse |
| US20180067972A1 (en) * | 2016-09-07 | 2018-03-08 | International Business Machines Corporation | Automatically setting an auto-purge value to multiple tables within a database |
| CN111339088A (en) * | 2020-02-21 | 2020-06-26 | 苏宁云计算有限公司 | Database division and table division method, device, medium and computer equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022001627A1 (en) * | 2020-07-03 | 2022-01-06 | 苏宁易购集团股份有限公司 | Data clearing method and apparatus, computer device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112000648B (en) | 2022-11-15 |
| WO2022001627A1 (en) | 2022-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110287709B (en) | User operation authority control method, device, equipment and medium | |
| CN111309785B (en) | Database access method and device based on Spring framework, computer equipment and medium | |
| CN110555041A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN109379398B (en) | Data synchronization method and device | |
| CN109460252B (en) | Configuration file processing method and device based on git and computer equipment | |
| CN112532687B (en) | Method and system for capacity expansion of kubernets load balancer | |
| CN107153643B (en) | Data table connection method and device | |
| CN111666131A (en) | Load balancing distribution method and device, computer equipment and storage medium | |
| CN110968647A (en) | Data storage method and device, computer equipment and storage medium | |
| CN112000648B (en) | Data clearing method and device, computer equipment and storage medium | |
| CN113065084B (en) | Data loading method and device, computer equipment and storage medium | |
| CN109684303B (en) | Communication code attribution inquiry method and device, computer equipment and storage medium | |
| CN110806942A (en) | Data processing method and device | |
| CN111259012A (en) | Data homogenizing method and device, computer equipment and storage medium | |
| CN114070820B (en) | Domain name redirection method, device, medium and electronic equipment | |
| CN110851421B (en) | Method and device for reducing time consumption of data migration, storage medium and electronic equipment | |
| CN110825732A (en) | Data query method and device, computer equipment and readable storage medium | |
| CN112100186A (en) | Data processing method and device based on distributed system and computer equipment | |
| CN110489222A (en) | Method for scheduling task, system, cluster server and readable storage medium storing program for executing | |
| CN116578247B (en) | Metadata-based data access method and system | |
| CN117075823B (en) | Object searching method, system, electronic device and storage medium | |
| CN115834532B (en) | Mapping method, device, equipment and medium for AD domain user to storage system | |
| CN114124541B (en) | Data processing method, device and equipment for rule ID and storage medium | |
| CN115499394B (en) | Message theme processing method, device, equipment and storage medium | |
| US20220197698A1 (en) | System and methods for subdividing an unknown list for execution of operations by multiple compute engines |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |