CN117056359B - Table reconstruction method and device, electronic equipment and storage medium - Google Patents
Table reconstruction method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117056359B CN117056359B CN202311310736.4A CN202311310736A CN117056359B CN 117056359 B CN117056359 B CN 117056359B CN 202311310736 A CN202311310736 A CN 202311310736A CN 117056359 B CN117056359 B CN 117056359B
- Authority
- CN
- China
- Prior art keywords
- temporary
- information
- name
- water level
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 101
- 230000004044 response Effects 0.000 claims description 28
- 238000012217 deletion Methods 0.000 claims description 9
- 230000037430 deletion Effects 0.000 claims description 9
- 230000005012 migration Effects 0.000 claims description 4
- 238000013508 migration Methods 0.000 claims description 4
- 238000004140 cleaning Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 238000013467 fragmentation Methods 0.000 description 7
- 238000006062 fragmentation reaction Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a table reconstruction method, a table reconstruction device, electronic equipment and a storage medium, and relates to the field of databases, wherein the method comprises the following steps: acquiring water level information and actual storage information of a first table in a database; the actual storage information characterizes the logical space size of the table data stored in the first table; determining whether the first table is a high water level table based on the water level information and the actual stored information; responding to the first table as a high water level table, and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table; migrating form data of the first form to a temporary form; and renaming the temporary table to obtain a second table. By the method and the device, table reconstruction can be intelligently controlled, the spatial water level of all tables in the database is reduced, and the query efficiency of the database is improved.
Description
Technical Field
The present disclosure relates to the field of databases, and in particular, to a method and apparatus for reconstructing a table, an electronic device, and a storage medium.
Background
With the rapid development and wide use of databases, the databases relate to frequent addition and deletion of data, when the physical space occupied by new data to be stored in the database is larger than the remaining physical space of old data blocks, the old data blocks are not used, but a larger physical space is newly opened up, at the moment, a high water line rises, and the frequent addition and deletion of data can lead to the excessive space water level of the table. Wherein, the space water level of the table refers to the physical occupation space of the table. In order to avoid the problem of low database query efficiency caused by overhigh spatial water level of the table, the existing method for reducing the spatial water level of the table adopts a shrnk (shrinkage) function of the database, but the shrnk function can only solve the problem of overhigh spatial water level of part of the table, so that the table is more hopefully reconstructed, the spatial water level of all the tables in the database is reduced, and the query efficiency of the database is improved.
Therefore, how to intelligently control the table reconstruction to reduce the spatial water level of all tables in the database and improve the query efficiency of the database is a technical problem to be solved.
Disclosure of Invention
The embodiment of the application provides a table reconstruction method, a table reconstruction device, electronic equipment and a storage medium.
According to a first aspect of the present application, there is provided a table reconstruction method, the method comprising: acquiring water level information and actual storage information of a first table in a database; the actual storage information characterizes the logical space size of the table data stored in the first table; determining whether the first table is a high water level table based on the water level information and the actual stored information; responding to the first table as a high water level table, and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table; migrating form data of the first form to the temporary form; and renaming the temporary table to obtain a second table.
According to an embodiment of the present application, after determining whether the first table is a high water level table based on the water level information and the actually stored information, the method further includes: establishing a table reconstruction plan of the database; in response to the first table being a high water table, inserting all first tables determined to be high water tables into the table reconstruction plan; updating a default state of a first table in the table reconstruction plan to a first state; sequentially reconstructing the first table with the default state being the first state based on the table reconstruction plan to obtain the second table; and updating the default state of the second table to a second state.
According to an embodiment of the present application, the determining whether the first table is a high water level table based on the water level information and the actually stored information includes: determining a physical occupation space of the first table based on the water level information; determining the data block logic occupied space and the data strip number information of the first table based on the actual storage information; the first table comprises at least one data block; determining the logic occupation space of the first table based on the logic occupation space of the data block and the data strip number information; and determining that the first table is a high water level table in response to the data block logic occupation space of the data block included in the first table is larger than a preset first logic space threshold value and the ratio of the physical occupation space to the logic occupation space of the first table is larger than a preset first ratio.
According to an embodiment of the present application, the responding that the first table is a high water level table, and establishing a temporary table corresponding to the first table based on table information of the first table includes: determining whether a temporary table corresponding to the first table exists in the database based on the table information of the first table; deleting the temporary table corresponding to the first table in response to the existence of the temporary table corresponding to the first table in the database; acquiring a table establishing statement of the first table from the table information; and establishing a temporary table corresponding to the first table based on the table establishment statement of the first table.
According to an embodiment of the present application, the migrating the table data of the first table to the temporary table includes: deleting the primary key and the index of the temporary table; migrating form data of the first form to the temporary form; adding the primary key and the index of the temporary table; acquiring external key information, unique key information and remark information corresponding to the temporary table; and adding the foreign key information, the unique key information and the remark information to the temporary table.
According to an embodiment of the present application, the renaming the temporary table to obtain a second table includes: renaming the table name of the first table from the first table name to a third table name; renaming the table name of the temporary table from a second table name to the first table name; deleting the first table of the third table name, and determining whether the first table of the third table name is successfully deleted; and in response to successful deletion of the first table of the third table name, renaming the index name and the key name of the temporary table of the first table name to obtain the second table.
According to an embodiment of the present application, after renaming the table name of the temporary table from the second table name to the first table name, the method further includes: determining whether renaming of the temporary table is successful; and renaming the first table from the third table name to the first table name in response to unsuccessful renaming of the temporary table.
According to a second aspect of the present application, there is provided a form reconstruction apparatus comprising: the acquisition module is used for acquiring water level information and actual storage information of a first table in the database; the actual storage information characterizes the logical space size of the table data stored in the first table; the determining module is used for determining whether the first table is a high water level table or not based on the water level information and the actual storage information; the establishing module is used for responding to the first table as a high water level table and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table; the migration module is used for migrating the table data of the first table to the temporary table; and the renaming module is used for renaming the temporary table to obtain a second table.
According to a third aspect of the present application, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described herein.
According to a fourth aspect of the present application, there is provided a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method described herein.
According to the method, water level information and actual storage information of a first table in a database are obtained; the actual storage information characterizes the logical space size of the table data stored in the first table; determining whether the first table is a high water level table based on the water level information and the actual stored information; responding to the first table as a high water level table, and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table; migrating form data of the first form to a temporary form; and renaming the temporary table to obtain a second table. Therefore, the table reconstruction can be intelligently controlled, the spatial water level of all tables in the database is reduced, and the query efficiency of the database is improved.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present application will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present application are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:
In the drawings, like or corresponding reference numerals indicate like or corresponding parts;
fig. 1 is a schematic process flow diagram of a table reconstruction method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a table reconstruction plan for creating a database according to an embodiment of the present application;
FIG. 3 is a schematic diagram of determining whether a first table is a high water level table according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a temporary table for establishing a first table according to an embodiment of the present application;
FIG. 5 is a schematic diagram of migrating table data of a first table to a temporary table according to an embodiment of the present application;
FIG. 6 shows a schematic diagram of determining a second table provided by an embodiment of the present application;
fig. 7 shows an application scenario diagram of a table reconstruction method provided in an embodiment of the present application;
fig. 8 illustrates another application scenario diagram of the table reconstruction method provided in the embodiment of the present application;
fig. 9 shows a further application scenario diagram of the table reconstruction method provided in the embodiment of the present application;
FIG. 10 is an alternative schematic diagram of a table reconstruction device according to an embodiment of the present disclosure;
fig. 11 shows a schematic diagram of a composition structure of an electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the objects, features and advantages of the present application more obvious and understandable, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the present application.
Before further describing embodiments of the present application in detail, the terms and expressions that are referred to in the embodiments of the present application are described, and are suitable for the following explanation.
High-Water Mark (HWM): the database runs for a period of time, after a series of data deleting, inserting and changing operations, when the physical space required by new data is larger than the rest physical space of old data blocks, the old data blocks are not used, but a larger physical space is newly opened up, the water level line of the table rises at the moment, and the existence of a high water level can influence the performance and the physical space utilization of the database. At this point, the table may be rebuilt to lower the water line of the table.
Referring to fig. 1, fig. 1 is a schematic process flow diagram of a table reconstruction method according to an embodiment of the present application, and will be described with reference to steps S101 to S105 shown in fig. 1.
Step S101, water level information and actual storage information of a first table in a database are acquired.
In some embodiments, the database may be an Oracle database, but may be other databases, and embodiments of the present application are not limited thereto. The first table may be any table in the database. The water level information may include a virtual increased water level of the table. The virtual added water bit refers to a data block of the physical occupied space of the table, in which no data is stored. The actual storage information may include the logical space occupation and the number of data pieces information of each data block of the first table. The data block is a storage unit with minimum granularity of the database, and each record contained in the first table corresponds to one data block. The number of data pieces information indicates the number of records included in the first table, i.e., the number of data blocks.
Step S102, based on the water level information and the actual storage information, whether the first table is a high water level table is determined.
In some embodiments, the high water level table may include a table that needs to be rebuilt through the table to reduce the water level. The high spatial water level of the high water level table can cause severe fragmentation of the table space, and the actual utilization rate of the table space is too low, so that the query efficiency of the database is affected. Tablespace (Tablespace) refers to the logical storage container of a table, and high-water table space refers to the physical footprint of a table.
In specific implementation, step S102 may include: according to the physical occupation space of the data block corresponding to the virtual water adding bit and the physical occupation space of the data block of the stored data, determining the physical occupation space of the first table; determining the logic occupied space of the data block and the data number information of the first table based on the actual storage information; determining the logic occupation space of the first table based on the logic occupation space of the data block and the data number information; and determining that the first table is a high water level table in response to the fact that the logic occupied space of the data blocks included in the first table is larger than a preset first logic space threshold value and the ratio of the physical occupied space to the logic occupied space of the first table is larger than a preset first ratio.
The preset first logic space threshold may include a preset minimum data block logic occupation space of each data block capable of determining that the first table is a high water level table. The preset first logical space threshold is preferably 100MB. The preset first ratio may include a preset minimum ratio capable of determining that the first table is a high water level table. The preset first ratio is preferably 1.4.
As an example, the preset first logical space threshold is 100MB. The preset first ratio is 1.4. And calculating the physical occupation space of the first table to be 10GB according to the virtual increase water level of the first table. Based on the actual stored information, it is determined that each data block of the first table logically occupies 1024MB and the number of data stripes is 5 (i.e., 5 data blocks). The first table includes 5 data blocks with a logical footprint of 1024 MB. And multiplying the logical occupied space of the data block by the data number information to obtain the logical occupied space of the first table which is 5GB. The data block logic occupation space 1024MB of each data block is larger than a preset first logic space threshold 100M, the ratio of the physical occupation space 10GB to the logic occupation space 5GB is 2, the ratio is larger than a preset first ratio value 1.4, and the first table is determined to be a high water level table.
In specific implementation, after step S102, the table reconstruction method may further include: establishing a table reconstruction plan of a database; in response to the first table being a high water table, inserting all of the first tables determined to be high water tables into the table rebuilding plan; updating a default state of a first table in the table reconstruction plan to a first state; based on the table reconstruction plan, sequentially reconstructing a first table with a default state as a first state to obtain a second table; the default state of the second table is updated to the second state. The first state may include a state of the table to be reconstructed, and the second state may include a state of the table reconstructed.
As an example, each table in the database is determined in step S102 whether the corresponding table is a high water level table, so as to obtain the high water level table in the database. It is determined whether a reconstruction plan (plan) table is empty. If the table is empty, a table reconstruction plan of the database is established in the plan table, and all high water level tables in the database are inserted into the table reconstruction plan. Updating the default state of the first table in the table reconstruction plan to be the state to be reconstructed, sequentially reconstructing the tables with the default state being the first state based on the table reconstruction plan to obtain a reconstructed second table, and updating the default state of the second table to be the reconstructed state. After the last form in the form reconstruction plan is reconstructed, the form reconstruction plan is emptied. If a form reconstruction plan to be performed, which is not reconstructed before the current moment in the plan establishment time and contains the form, exists in the plan table, sequentially reconstructing a form with a default state being a first state based on the form reconstruction plan to be performed, and obtaining a reconstructed form until the plan table is empty. Then, a table reconstruction plan of the database is established in the plan table, and all high water level tables in the database are inserted into the table reconstruction plan. Updating the default state of the first table in the table reconstruction plan to be the state to be reconstructed, sequentially reconstructing the tables with the default state being the first state based on the table reconstruction plan to obtain a reconstructed second table, and updating the default state of the second table to be the reconstructed state. After the last form in the form reconstruction plan is reconstructed, the form reconstruction plan is emptied.
Step S103, responding to the first table as a high water level table, and establishing a temporary table corresponding to the first table based on the table information of the first table.
In specific implementation, step S103 may include: determining whether a temporary table corresponding to the first table exists in the database based on the table information of the first table; deleting the temporary table corresponding to the first table in response to the temporary table corresponding to the first table in the database; acquiring a table establishing statement of a first table from the table information; and establishing a temporary table corresponding to the first table based on the table establishment statement of the first table.
Wherein, the table information may include: the method comprises the steps of establishing a table statement of a first table and temporary table information corresponding to the first table. The temporary table information may include a table name of the temporary table. The temporary table (temp table) may include: the table is temporarily stored. The temporary table corresponding to the established first table may include: primary keys, other keys, and indexes.
Step S104, the table data of the first table is migrated to the temporary table.
In specific implementation, step S104 may include: deleting the primary key and the index of the temporary table; migrating form data of the first form to a temporary form; adding a primary key and an index of the temporary table; and acquiring external key information, unique key information and remark information corresponding to the temporary table. The foreign key information, the information of the unique key, and the remark information are added to the temporary table.
Wherein the table data may comprise data stored by the first table. Migrating the table data of the first table to the temporary table may include: and copying the table data of the first table, and inserting the copied data into the temporary table. The primary key of the temporary table may include a temp primary key. The index of the temporary table may be obtained from all_indices and all_ind_columns views. The index of the temporary table may include a normal index and a spatial index. The foreign key information and the unique key information of the temporary table can be obtained from all_restrictions and all_con_columns. The remark information of the temporary table may be obtained from all_tab_comments and all_col_comments views.
Step S105, renaming the temporary table to obtain a second table.
In specific implementation, step S105 may include: renaming the table name of the first table from the first table name to a third table name; renaming the temporary table name from the second table name to the first table name; determining whether renaming of the temporary table is successful; in response to unsuccessful renaming of the temporary table, renaming the first table to the first table name from the third table name. Deleting the first table of the third table name in response to successful renaming of the temporary table, and determining whether the first table of the third table name is deleted successfully; renaming the first table from the third table name to the second table name in response to the first table of the third table name not being deleted successfully; and in response to the successful deletion of the first table of the third table name, renaming the index name and the key name of the temporary table of the first table name to obtain a second table.
Wherein, the space water level of the second table is lower than that of the original first table.
As an example, the table name of the first table is a, and the table name of the temporary table is B (temp).
1. The table name of the first table is renamed from a to C. If successful, the first table is named C and the temporary table is named B (temp).
2. The table name of the temporary table is renamed from B to a. At this time, there are a first table C and a temporary table a.
3. Determining whether the table name of the temporary table is A (temp), namely whether the temporary table renaming is successful, if the temporary table renaming fails, recovering the table name of the first table, namely renaming the table name from C to A, wherein the table name of the first table is A and the table name of the temporary table is B (temp); if the temporary table renaming is successful, the table name of the first table is C, and the table name of the temporary table is A (temp).
4. Deleting the first table C and determining whether the first table C was deleted successfully.
If the first table C is not deleted successfully, renaming the table name of the first table from C to B, wherein the table name of the first table is B and the table name of the temporary table is A (temp); if the first table C is successfully deleted, only a temporary table is present, and the table name of the temporary table is a (temp).
5. The index name of the temporary table with the table name a (temp) is renamed from each index name in the temporary table to each index name in the first table. The key name of the temporary table with the table name a (temp) is renamed from each key name in the temporary table to each key name in the first table. And determining the temporary table with the index name and the key name which are all renamed as a second table.
In some embodiments, the process flow of formulating a table rebuild plan for a database, as shown in FIG. 2, includes:
step S201, a table reconstruction plan of a database is established.
In step S202, in response to the first table being the high water level table, all the first tables determined to be the high water level tables are inserted into the table rebuilding plan.
Step S203, the default state of the first table in the table rebuilding plan is updated to the first state.
Step S204, based on the table reconstruction plan, sequentially reconstructing the first table with the default state as the first state to obtain the second table.
In step S205, the default state of the second table is updated to the second state.
According to the method, through steps S201-S205, a plurality of tables can be automatically rebuilt according to the table rebuilding plan, and only the table names and the mode names are required to be known. The schema (stream) is an organization and structure of the database, and the schema includes schema objects, which may be tables, columns, data types, views, storage processes, relationships, primary keys, foreign keys, and the like. And the code does not need to be written, so that the risk caused by manual operation is greatly reduced. The automatic management tool is used for reconstructing the table, so that the space water level of all tables in the database is reduced, the query efficiency of the database is improved, the fragmentation of the table space is reduced, the actual utilization rate of the table space is improved, and the time cost is saved.
The specific explanation of each of the steps S201 to S205 is the same as the step S102 described above, and will not be repeated here.
In some embodiments, the process of determining whether the first table is a high water table, as shown in FIG. 3, includes:
step S301, determining a physical occupation space of the first table based on the water level information.
Step S302, based on the actual storage information, determining the data block logic occupied space and the data strip number information of the first table.
Step S303, determining the logic occupation space of the first table based on the logic occupation space of the data block and the data number information.
In step S304, in response to the data block logic occupied space of the data block included in the first table being greater than the preset first logic space threshold, and the ratio of the physical occupied space to the logic occupied space of the first table being greater than the preset first ratio, the first table is determined to be a high water level table.
According to the method provided by the embodiment of the application, through the steps S301-S304, the high water level table to be rebuilt in the database can be automatically determined according to the high water level judgment rule of the table, codes are not required to be written, and risks caused by manual operation are greatly reduced. The automatic management tool is used for reconstructing the table, so that the space water level of all tables in the database is reduced, the query efficiency of the database is improved, the fragmentation of the table space is reduced, the actual utilization rate of the table space is improved, and the time cost is saved.
The specific explanation of each of the steps S301 to S304 is the same as that of the step S102 described above, and will not be repeated here.
In some embodiments, the process flow for creating the temporary table corresponding to the first table, as shown in fig. 4, includes:
step S401, determining whether a temporary table corresponding to the first table exists in the database based on the table information of the first table.
Step S402, deleting the temporary table corresponding to the first table in response to the existence of the temporary table corresponding to the first table in the database.
Step S403, a table establishing statement of the first table is obtained from the table information.
Step S404, based on the statement of the first table, a temporary table corresponding to the first table is established.
According to the method provided by the embodiment of the application, through the steps S401-S404, a plurality of tables can be automatically rebuilt according to the table rebuilding plan, only the table names and the mode names are needed to be known, codes are not needed to be written, and the risk caused by manual operation is greatly reduced. The automatic management tool is used for reconstructing the table, so that the space water level of all tables in the database is reduced, the query efficiency of the database is improved, the fragmentation of the table space is reduced, the actual utilization rate of the table space is improved, and the time cost is saved.
The specific explanation of each of the steps S401 to S404 is the same as the step S103 described above, and will not be repeated here.
In some embodiments, the process flow of migrating the table data of the first table to the temporary table, as shown in fig. 5, includes:
in step S501, the primary key and index of the temporary table are deleted.
In step S502, the table data of the first table is migrated to the temporary table.
In step S503, the primary key and index of the temporary table are added.
Step S504, external key information, unique key information and remark information corresponding to the temporary table are obtained.
In step S505, foreign key information, unique key information, and remark information are added to the temporary table.
According to the method provided by the embodiment of the application, through the steps S501-S505, the table data can be copied into the temporary table after the primary key and the index are deleted, so that the data insertion performance is improved, the data migration time is shortened, the code is not required to be written, and the risk caused by manual operation is greatly reduced. The automatic management tool is used for reconstructing the table, so that the space water level of all tables in the database is reduced, the query efficiency of the database is improved, the fragmentation of the table space is reduced, the actual utilization rate of the table space is improved, and the time cost is saved.
The specific explanation of each of the steps S501 to S505 is the same as that of the step S104 described above, and will not be repeated here.
In some embodiments, the process flow of determining the second table, as shown in fig. 6, includes:
in step S601, the table name of the first table is renamed from the first table name to the third table name.
In step S602, the table name of the temporary table is renamed from the second table name to the first table name.
Step S603, it is determined whether renaming of the temporary table is successful.
In step S604a, in response to unsuccessful renaming of the temporary table, renaming the first table to the first table name from the third table name.
In step S604b, the first table of the third table name is deleted in response to the renaming success of the temporary table.
Step S605 determines whether the deletion of the first table of the third table name is successful.
In step S606a, in response to the first table of the third table name not being deleted successfully, the first table is renamed from the third table name to the second table name.
In step S606b, in response to the successful deletion of the first table of the third table name, renaming the index name and the key name of the temporary table of the first table name to obtain the second table.
In some embodiments, in the index and key name stage of renaming the temporary table, even if renaming the index name fails, the index name and key name are inconsistent with the original table without affecting the use and functional availability of the original table. The rename code will replace all temporary markers, regardless of how many times it has been previously failed for environmental reasons, and will restore the index name once.
On the premise of being repeatedly executed, each of the steps S601-S606b ensures one or two original table data. When the report is in error suspension, even the sudden extreme condition can judge the data condition of the current database through the log. CRM (customer relationship management) system data of the database can be restored by: the deleted data is stored in the recycle bin and recovered from the recycle bin. The data may be restored to a specified point in time according to the automatic backup mechanism of the system. The data dump is backed up at regular time and is restored from the dump file.
According to the method provided by the embodiment of the application, through the steps S601-S606b, an error rollback mechanism can be utilized, original data can be completely reserved when errors occur, the data safety is improved, the function usability of the corresponding table of the database cannot be affected, codes do not need to be written, and the risk caused by manual operation is greatly reduced. The automatic management tool is used for reconstructing the table, so that the space water level of all tables in the database is reduced, the query efficiency of the database is improved, the fragmentation of the table space is reduced, the actual utilization rate of the table space is improved, and the time cost is saved.
The specific explanation of each of the steps S601 to S606b is the same as that of the step S105 described above, and will not be repeated here.
Fig. 7 shows an application scenario diagram of a table reconstruction method provided in an embodiment of the present application.
Referring to fig. 7, an application scenario of a table reconstruction method provided in the embodiment of the present application is applied to automatic cleaning of a table space high water level, and first, through step 701, it is determined whether a temporary table corresponding to a first table exists. If so, deleting the temporary table corresponding to the first table in step 702a, acquiring a table construction statement of the first table in step 702b, and establishing the temporary table corresponding to the first table. If not, directly obtaining a table establishment statement of the first table through step 702b, and establishing a temporary table corresponding to the first table. The primary key and index of the temporary table are deleted, via step 703. All table data for the first table is inserted into the temporary table, via step 704. The primary key and index are added to the temporary table, via step 705. Foreign key information and unique key information are added to the temporary table, via step 706. The remark information of the temporary table is added to the temporary table, via step 707. The table name of the first table is changed from the first table name to a third table name, via step 708. The temporary table name is modified from the second table name to the first table name, via step 709. The table of the third table name and all its associated indexes and primary keys are deleted, via step 710. The key name of the new temporary table obtained is modified to the key name of the first table, via step 711. The index name of the new temporary table obtained is modified to the index name of the first table, via step 712. Thus, the reconstruction of the table is completed, and the spatial water level of the table is reduced.
It can be appreciated that the application scenario of the table reconstruction method of fig. 7 is only a part of exemplary implementation of the embodiment of the present application, and the application scenario of the table reconstruction method in the embodiment of the present application includes, but is not limited to, the application scenario of the table reconstruction method shown in fig. 7.
Fig. 8 shows another application scenario diagram of the table reconstruction method provided in the embodiment of the present application.
Referring to fig. 8, another application scenario of the table reconstruction method provided in the embodiment of the present application is applied to table renaming and an abnormal rollback mechanism.
The first table is named a table, the temporary table is named B (temp) table, and the third table is named C table. First, the table name of the first table is renamed from a to C, via step 81. At this time, the table name of the first table is C, and the table name of the temporary table is B (temp).
Then, the temporary table is renamed from B to a, via step 82. At this time, there are a first table C and a temporary table a. Determining whether the table name of the temporary table is a (temp), that is, whether the temporary table renaming is successful, if the temporary table renaming fails, recovering the table name of the first table, that is, renaming from C to a, in step 83, wherein the table name of the first table is a and the table name of the temporary table is B (temp); if the temporary table renaming is successful, the table name of the first table is C, and the table name of the temporary table is A (temp). The first table C is deleted, and a determination is made as to whether the deletion of the first table C was successful, via step 84.
If the first table C is not deleted successfully, renaming the table name of the first table from C to B in step 85, wherein the table name of the first table is B and the table name of the temporary table is a (temp); if the first table C is successfully deleted, only a temporary table is present, and the table name of the temporary table is a (temp).
It can be appreciated that the application scenario of the table reconstruction method of fig. 8 is only a part of exemplary implementation of the embodiment of the present application, and the application scenario of the table reconstruction method in the embodiment of the present application includes, but is not limited to, the application scenario of the table reconstruction method shown in fig. 8.
Fig. 9 shows another application scenario diagram of the table reconstruction method provided in the embodiment of the present application.
Referring to fig. 9, still another application scenario of the table reconstruction method provided in the embodiment of the present application is applied to determining a cleaning plan of a table space high water level in a database. First, through step 90, it is determined whether the cleaning schedule is empty.
If the cleaning plan is empty, a cleaning plan of the database is generated and inserted into the cleaning plan table through the step 91; at least one high water level table may be included in the cleaning plan. And updating the flag (identification) field of the high water level table in the table reconstruction plan to 0. And then, through step 92, a table with a flag field of 0 in the cleaning plan is found, a table reconstruction process is executed, and cleaning is performed.
If not, a table with a flag field of 0 in the cleaning plan is found in step 92, and a table rebuilding process is performed to clean the table.
A table is cleaned up by step 93, setting the flag field of the table to 1 and setting the flag field to 1 in the cleaning plan indicates that the table has been cleaned up. And repeating the process of step 92, and cleaning the tables with the flag fields of 0 in the cleaning plan until the flag fields of all the tables in the cleaning plan included in the cleaning plan are 1.
Finally, the schedule is cleaned by a step 94, the cleaning schedule data is deleted, and the cleaning is ended.
It can be appreciated that the application scenario of the table reconstruction method of fig. 9 is only a part of exemplary implementation of the embodiment of the present application, and the application scenario of the table reconstruction method in the embodiment of the present application includes, but is not limited to, the application scenario of the table reconstruction method shown in fig. 9.
Therefore, compared with the prior art that the spatial water level of partial tables can be solved only through the krnk function of the database and the spatial water level of all the tables can not be reduced through the table reconstruction, the table reconstruction method can reconstruct the tables by using an automatic management tool so as to reduce the spatial water level of all the tables in the database, improve the query efficiency of the database, reduce the fragmentation of the table space, improve the actual use rate of the table space and save the time cost.
It should be noted that, the order of execution does not exist between the steps of the table reconstruction method provided in the embodiment of the present application, and the order of execution between the steps of the table reconstruction method provided in the embodiment of the present application may be adaptively changed based on the logical relationship.
Continuing with the description below of an exemplary structure implemented as a software module for the table reconstruction device 90 provided in embodiments of the present application, in some embodiments, as shown in fig. 10, the software modules in the table reconstruction device 90 may include: the acquisition module 901 is configured to acquire water level information and actual storage information of a first table in a database; a determining module 902, configured to determine whether the first table is a high water level table based on the water level information and the actual stored information; the establishing module 903 is configured to establish a temporary table corresponding to the first table based on the table information of the first table in response to the first table being a high water level table; a migration module 904, configured to migrate table data of the first table to a temporary table; and a renaming module 905, configured to rename the temporary table to obtain a second table. It should be noted that, the description of the apparatus in the embodiment of the present application is similar to the description of the embodiment of the method described above, and has similar beneficial effects as the embodiment of the method, so that a detailed description is omitted. The details of the table reconstruction device provided in the embodiments of the present application may be understood from the description of any one of fig. 1 to 9.
According to embodiments of the present application, there is also provided an electronic device and a non-transitory computer-readable storage medium.
Fig. 11 shows a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
As shown in fig. 11, the electronic device 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.
Various components in electronic device 800 are connected to I/O interface 805, including: an input unit 806 such as a keyboard, mouse, etc.; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, or the like. The communication unit 809 allows the electronic device 800 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
The computing unit 801 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the respective methods and processes described above, such as a table reconstruction method. For example, in some embodiments, the table reconstruction method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 800 via the ROM 802 and/or the communication unit 809. When a computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the table reconstruction method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the table reconstruction method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present application may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this application, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present disclosure may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solutions disclosed in the present application are achieved, and are not limited herein.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (8)
1. A method of table reconstruction, the method comprising:
acquiring water level information and actual storage information of a first table in a database; the actual storage information characterizes the logical space size of the table data stored in the first table;
determining a physical occupation space of the first table based on the water level information; determining the data block logic occupied space and the data strip number information of the first table based on the actual storage information; the first table comprises at least one data block; determining the logic occupation space of the first table based on the logic occupation space of the data block and the data strip number information; determining that the first table is a high water level table in response to the data block logic occupation space of the data block included in the first table being greater than a preset first logic space threshold and the ratio of the physical occupation space to the logic occupation space of the first table being greater than a preset first ratio;
responding to the first table as a high water level table, and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table;
Migrating form data of the first form to the temporary form;
renaming the table name of the first table from the first table name to a third table name; renaming the table name of the temporary table from a second table name to the first table name; deleting the first table of the third table name, and determining whether the first table of the third table name is successfully deleted; and in response to the successful deletion of the first table of the third table name, renaming the index name and the key name of the temporary table of the first table name to obtain a second table.
2. The method of claim 1, wherein after the determining whether the first table is a high water level table based on the water level information and the actual stored information, the method further comprises:
establishing a table reconstruction plan of the database;
in response to the first table being a high water table, inserting all first tables determined to be high water tables into the table reconstruction plan;
updating a default state of a first table in the table reconstruction plan to a first state;
sequentially reconstructing the first table with the default state being the first state based on the table reconstruction plan to obtain the second table;
And updating the default state of the second table to a second state.
3. The method of claim 1, wherein the establishing a temporary table corresponding to the first table based on the table information of the first table in response to the first table being a high water level table comprises:
determining whether a temporary table corresponding to the first table exists in the database based on the table information of the first table;
deleting the temporary table corresponding to the first table in response to the existence of the temporary table corresponding to the first table in the database;
acquiring a table establishing statement of the first table from the table information;
and establishing a temporary table corresponding to the first table based on the table establishment statement of the first table.
4. The method of claim 1, wherein said migrating the table data of the first table to the temporary table comprises:
deleting the primary key and the index of the temporary table;
migrating form data of the first form to the temporary form;
adding the primary key and the index of the temporary table;
acquiring external key information, unique key information and remark information corresponding to the temporary table;
And adding the foreign key information, the unique key information and the remark information to the temporary table.
5. The method of claim 1, wherein after renaming the table name of the temporary table from the second table name to the first table name, the method further comprises:
determining whether renaming of the temporary table is successful;
and renaming the first table from the third table name to the first table name in response to unsuccessful renaming of the temporary table.
6. A form reconstruction apparatus, the form reconstruction apparatus comprising:
the acquisition module is used for acquiring water level information and actual storage information of a first table in the database; the actual storage information characterizes the logical space size of the table data stored in the first table;
the determining module is used for determining the physical occupied space of the first table based on the water level information; determining the data block logic occupied space and the data strip number information of the first table based on the actual storage information; the first table comprises at least one data block; determining the logic occupation space of the first table based on the logic occupation space of the data block and the data strip number information; determining that the first table is a high water level table in response to the data block logic occupation space of the data block included in the first table being greater than a preset first logic space threshold and the ratio of the physical occupation space to the logic occupation space of the first table being greater than a preset first ratio;
The establishing module is used for responding to the first table as a high water level table and establishing a temporary table corresponding to the first table based on table information of the first table; the table information comprises a table establishing statement of the first table and temporary table information corresponding to the first table;
the migration module is used for migrating the table data of the first table to the temporary table;
the renaming module is used for renaming the table name of the first table from the first table name to a third table name; renaming the table name of the temporary table from a second table name to the first table name; deleting the first table of the third table name, and determining whether the first table of the third table name is successfully deleted; and in response to the successful deletion of the first table of the third table name, renaming the index name and the key name of the temporary table of the first table name to obtain a second table.
7. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
8. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311310736.4A CN117056359B (en) | 2023-10-09 | 2023-10-09 | Table reconstruction method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311310736.4A CN117056359B (en) | 2023-10-09 | 2023-10-09 | Table reconstruction method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117056359A CN117056359A (en) | 2023-11-14 |
| CN117056359B true CN117056359B (en) | 2024-01-09 |
Family
ID=88664801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311310736.4A Active CN117056359B (en) | 2023-10-09 | 2023-10-09 | Table reconstruction method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117056359B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388626A (en) * | 2018-02-12 | 2018-08-10 | 平安科技（深圳）有限公司 | SQL automatic optimization methods, device, computer equipment and storage medium |
| CN111400321A (en) * | 2020-03-23 | 2020-07-10 | 上海新炬网络技术有限公司 | Method for automatically recycling high water level based on ORAC L E database |
| CN113168413A (en) * | 2018-10-09 | 2021-07-23 | 塔谱软件公司 | Correlated incremental loading of multiple data sets for interactive data preparation applications |
| CN113377763A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Database table switching method and device, electronic equipment and computer storage medium |
| CN114090577A (en) * | 2021-11-04 | 2022-02-25 | 支付宝(杭州)信息技术有限公司 | Time sequence data storage and reading method and device |
| CN114328526A (en) * | 2021-12-27 | 2022-04-12 | 中国电信股份有限公司 | Data processing method and device, electronic equipment and computer readable storage medium |
| CN116804994A (en) * | 2023-08-23 | 2023-09-26 | 北京逐风科技有限公司 | Data synchronization method, system, device, electronic equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040117408A1 (en) * | 2002-12-17 | 2004-06-17 | Capital One Financial Corporation | Systems, methods and articles of manufacture for determining available space in a database |
| US20090193039A1 (en) * | 2008-01-28 | 2009-07-30 | Apollo Data Technologies, Llc | Data driven system for data analysis and data mining |
| CN108287835B (en) * | 2017-01-09 | 2022-06-21 | 腾讯科技（深圳）有限公司 | Data cleaning method and device |
| US11537574B2 (en) * | 2020-07-20 | 2022-12-27 | Salesforce.Com, Inc. | Autonomous database defragmentation |
-
2023
- 2023-10-09 CN CN202311310736.4A patent/CN117056359B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388626A (en) * | 2018-02-12 | 2018-08-10 | 平安科技（深圳）有限公司 | SQL automatic optimization methods, device, computer equipment and storage medium |
| CN113168413A (en) * | 2018-10-09 | 2021-07-23 | 塔谱软件公司 | Correlated incremental loading of multiple data sets for interactive data preparation applications |
| CN113377763A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Database table switching method and device, electronic equipment and computer storage medium |
| CN111400321A (en) * | 2020-03-23 | 2020-07-10 | 上海新炬网络技术有限公司 | Method for automatically recycling high water level based on ORAC L E database |
| CN114090577A (en) * | 2021-11-04 | 2022-02-25 | 支付宝(杭州)信息技术有限公司 | Time sequence data storage and reading method and device |
| CN114328526A (en) * | 2021-12-27 | 2022-04-12 | 中国电信股份有限公司 | Data processing method and device, electronic equipment and computer readable storage medium |
| CN116804994A (en) * | 2023-08-23 | 2023-09-26 | 北京逐风科技有限公司 | Data synchronization method, system, device, electronic equipment and storage medium |
Non-Patent Citations (5)
| Title |
|---|
| Locating and accessing large datasets using Flower Index Approach;Kvet, Michal etc.;《CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE》;第1-13页 * |
| ORACLE数据库自动化碎片整理研究与应用;杨永娇;《自动化与仪器仪表》;第223-226页 * |
| Temporal data retrieval efficiency;Michal Kvet etc.;《2017 IEEE 14th International Scientific Conference on Informatics》;第197-202页 * |
| 基于Oracle数据库开发系统的物理设计优化策略;苏大威 等;《计算机工程》;第115-116页 * |
| 浅谈ORACLE高水位线的解决方法;廉文超;;通讯世界(第19期);第271-272页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117056359A (en) | 2023-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8204892B2 (en) | Performance boost for sort operations | |
| US8180811B2 (en) | Identifying unreferenced file system components | |
| CN109213432B (en) | Storage device for writing data using log structured merge tree and method thereof | |
| CN111666266A (en) | Data migration method and related equipment | |
| CN113364877A (en) | Data processing method, device, electronic equipment and medium | |
| US20230012642A1 (en) | Method and device for snapshotting metadata, and storage medium | |
| CN113254267B (en) | Data backup method and device for distributed database | |
| CN117056359B (en) | Table reconstruction method and device, electronic equipment and storage medium | |
| US11093348B2 (en) | Method, device and computer program product for recovering metadata | |
| CN112783447A (en) | Method, apparatus, device, medium, and article of manufacture for processing snapshots | |
| US10248673B2 (en) | Allocating free space in a database | |
| CN112860376B (en) | Snapshot chain manufacturing method and device, electronic equipment and storage medium | |
| CN116340318A (en) | Method, device, equipment and storage medium for processing secondary index record | |
| CN115617802A (en) | Method and device for quickly generating full snapshot, electronic equipment and storage medium | |
| CN115510036A (en) | Data migration method, device, equipment and storage medium | |
| CN107590286B (en) | Method and device for managing transaction information in cluster file system | |
| CN112559547A (en) | Method and device for determining consistency among multiple storage object copies | |
| CN114385415A (en) | Method and device for virtual machine to backup across backup storage pools | |
| CN116737453A (en) | Data dump method, device, electronic equipment and storage medium | |
| CN114780021B (en) | Copy repairing method and device, electronic equipment and storage medium | |
| CN115586871B (en) | Cloud computing scene-oriented data additional writing method, device, equipment and medium | |
| CN117082046A (en) | Data uploading method, device, equipment and storage medium | |
| CN117667242A (en) | Data processing method, device, electronic equipment and storage medium | |
| CN116431394A (en) | Checkpoint construction method and device, electronic equipment and storage medium | |
| CN115757452A (en) | Blocking method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |