WO2015168988A1

WO2015168988A1 - Data index creation method and device, and computer storage medium

Info

Publication number: WO2015168988A1
Application number: PCT/CN2014/082640
Authority: WO
Inventors: 谢东; 喻红宇
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-05-07
Filing date: 2014-07-21
Publication date: 2015-11-12
Also published as: CN105095255A

Abstract

A data index creation method and device, and a computer storage medium. The method comprises: acquiring a data filtering condition; and according to the data filtering condition, screening target table data to obtain table data satisfying the data filtering condition, and creating an index for the target table data satisfying the data filtering condition.

Description

Data index creation method, device and calculation storage medium

The present invention relates to the field of database technologies, and in particular, to a data index creation method, apparatus, and computer storage medium. Background technique

A database is a data processing device that has been developed to meet the needs of data processing. The germination of the database system appeared in 1960, and in 1970 the concept of a relational model of the database was proposed, on the basis of which a relational database was formed.

The relational database is a database based on the relational database model and has a solid mathematical theoretical basis. With the development of information technology, the database has penetrated into various industries and applications, and the relational database has been widely used in various industries. However, the world has undergone earth-shaking changes, and the data characteristics have changed greatly compared to the era when the database concept was just presented. Those complex and large amounts of data are collectively referred to as big data. Faced with this type of data, traditional relational database systems have shown more and more drawbacks.

Relational databases use Structured Query Language (SQL, Structured Query Language) as the database operation language. SQL has been revised several times since its introduction. In 1974, SQL was first implemented by IBM. In 1986, the US National Bureau of Standards adopted the American Standard for Database Language. In 1987, the International Organization for Standardization (ISO) adopted ANSI SQL as an international standard. In 1989, ISO introduced the SQL89 standard with integrity characteristics. In 1992, ISO published the SQL92 standard.

The cable is a structure for sorting the values in the data table of the database. The index can be used to quickly access specific information in the database table. In the prior art, the method for creating a database index is: by analyzing the application usage scenario of the database, and analyzing the query conditions of the SQL statement, and then obtaining the index and its candidate fields that may be needed, and finally considering various factors such as performance, One or more columns of the data table are used as index fields to create one or more indexes. Since each index is for all data in the data table, the value of the index field of any data in the data table corresponds to one index data in the index. If the value of the index field of any piece of data is changed, deleted, or changed, the index data needs to be added or deleted.

Faced with the change of the characteristics of modern data, the amount of data in the index created by the prior art is large, the occupied space is also larger, and the storage cost is higher and higher, which obviously affects the efficiency of the user accessing the data table information. At the same time, the index is used during the execution of the SQL statement to enable the user to quickly access the data, but because some of the data in the index has not been used by SQL for a long time, the utilization of the index data is reduced.

In addition, as the data increases, the maintenance cost increases accordingly, and application access becomes more and more slow, which increases the difficulty of deleting data, the system scalability is poor, and the maintenance cost of the index is also improved. In the era of big data, data is expanding, but current commercial relational databases are suitable for processing tables with records in the order of tens of millions of data. In some large systems, when the amount of table data reaches a higher order of magnitude, for example: terabytes (TB, TeraByte), beat bytes (PB, PetaByte), ten trillions of bytes (ZB, ZettaByte), due to The amount of data in the index is huge, not only is it difficult to insert new data, but it is also difficult to create new indexes. Summary of the invention

In order to solve the existing technical problems, the embodiment of the present invention provides a data index creation method, which includes the following steps:

Obtain data filtering conditions;

According to the data filtering condition, the target table data is selected to obtain table data satisfying the data filtering condition, and an index is created for the target table data satisfying the data filtering condition.

Optionally, the target table data is selected according to the data filtering condition to obtain table data that meets the data filtering condition, and an index is created for the table data that meets the data filtering condition, including: Read the target table data in the database;

When it is determined that the target table data satisfies the data filtering condition, the target table data that satisfies the data filtering condition is calculated to obtain index data;

The index data is written to the location of the corresponding pointer on the index.

Preferably, after the index data is written to the position of the corresponding pointer on the index, the method further includes:

Determining whether the index is created, and obtaining the judgment result; when the judgment result is that the index is created, ending the operation; when the judgment result is that the index is not created, re-reading the target table data in the database, When it is determined that the target table data satisfies the data filtering condition, the target table data that satisfies the data filtering condition is calculated to obtain index data; and the index data is written into a position of the corresponding pointer on the index.

Preferably, the obtaining the data filtering condition is: obtaining a data filtering condition by using an SQL command for creating an index.

Preferably, when the data is big data, the data filtering condition includes: selecting, from the grouping of the table data according to the data life cycle, a filtering condition according to the target group used to create the index.

Preferably, the data filtering condition is implemented by a where statement, or by a statement containing a range of words, or by a statement containing a list word.

The embodiment of the invention further provides a data index creation device, including:

a data filtering condition obtaining module configured to obtain a data filtering condition;

The index creation module is configured to select, according to the data filtering condition acquired by the data filtering condition acquisition module, the table data that meets the filtering condition, and create an index on the table data that satisfies the data filtering condition.

Optionally, the index creation module includes:

a table data reading unit configured to read target table data in the database; The data filtering condition determining unit is configured to determine whether the target table data read by the table data reading unit satisfies the data filtering condition, and trigger a computing unit when the target table data satisfies the data filtering condition;

a calculating unit configured to calculate target data that meets the data filtering condition to obtain index data;

The index data writing unit is configured to write the index data obtained by the calculating unit to a position of a corresponding pointer on the index.

Optionally, the index creation module further includes a data discriminating unit configured to determine whether an unread table exists in the database after the index data writing unit writes the index data to a position of a corresponding pointer on the index. Data, and if the index is not created, triggering the table data reading unit to continue reading the target table data in the database.

Preferably, the data filtering condition obtaining module is configured to acquire a data filtering condition by using an indexed SQL command.

Preferably, the data is big data, and the data filtering condition includes: selecting, from the grouping of the table data according to the data life cycle, a selection condition according to the target group used to create the index.

The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the data index creation method according to the embodiment of the present invention.

As can be seen from the above, the data index creation method provided by the embodiment of the present invention filters the target table data according to certain data filtering conditions when the index is created, and filters the target table data that does not satisfy the data filtering condition. Indexes are only created for a portion of the data in the database, so the amount of data in the index is greatly reduced. At the same time filtered, basically not used The target table data is filtered out of the index, which makes the index usage efficiency significantly improved. In addition, because of the filtering of redundant table data, the speed at which users access the database through the index is improved. The maintenance cost of the index is also reduced. After the index is reduced, the operation of adding and deleting data becomes simple; the speed of creating the index is improved, the difficulty is reduced, and the time is reduced, making it easier for the user to create a new index according to his needs. In particular, when an index is created for big data or massive data, the method provided by the embodiments of the present invention can form an index more quickly.

In addition, the data index creation method of the embodiment of the present invention allows the database developer to manage the database according to the actual life and according to the data life cycle: According to the embodiment of the present invention, the database developer can first determine the screening condition of the index through the user requirement. Establish a corresponding index; then maintain the index according to the data life cycle. When creating an index, there is no longer a need to separate hot and cold data from the table, nor data migration, and the database design will be more reasonable.

The data index creation device further provided by the embodiment of the present invention has a small amount of index data, low maintenance cost, and high query query execution efficiency. In addition, it is more conducive to the rational design and management of the database. DRAWINGS

FIG. 1 is a flowchart of a method for creating a data index according to an embodiment of the present invention;

2 is an implementation of the step of filtering the target table data according to the data filtering condition to obtain table data satisfying the data filtering condition, and creating an index for the target table data satisfying the data filtering condition according to the data filtering condition. Mode flow chart;

3 is a flowchart of a method for creating a data index according to a preferred embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a data index creation apparatus according to an embodiment of the present invention. detailed description

In order to provide an effective implementation, the present invention provides the following embodiments, and the embodiments of the present invention will be described below in conjunction with the accompanying drawings. A data index creation method according to an embodiment of the present invention includes the following steps: acquiring a data filtering condition;

FIG. 1 is a flowchart of a method for creating a data index according to an embodiment of the present invention; the foregoing method may be implemented by using the process shown in FIG. 1, and includes the following steps:

Step 101: Obtain data filtering conditions.

Here, the obtaining data filtering condition is: acquiring a data filtering condition by using an SQL command for creating an index.

As an embodiment, the data filtering condition is obtained by analyzing user software requirements, generating an SQL command for creating an index, and resolving the SQL command for creating the index. The data filtering condition may also be that the database receives an instruction for the user to create an index, and obtains a data filtering condition from the instruction for creating the index.

Step 102: Filter the target table data according to the data filtering condition to obtain table data that satisfies the data filtering condition, and create an index on the table data that satisfies the data filtering condition.

In a specific embodiment, the target table data may be judged one by one whether the data filtering condition is met, and when it is determined that the target table data satisfies the data filtering condition, the target table data is calculated to obtain index data; The index data calculated by satisfying the data filter condition target table data constitutes a complete index.

The data filtering condition may be a range condition for selecting the data content of the target table, for example, a range condition for filtering the name, the attribute, the size, the recording time, and the like.

In another specific embodiment, all the target table data satisfying the data filtering condition may be selected first, and then the target table data satisfying the data filtering condition may be calculated one by one, and finally a complete index is created.

The method for creating a data index provided by the embodiment of the present invention is based on a certain The data filtering condition filters the target table data, filters the target table data that does not satisfy the data filtering condition, and creates an index only for a certain part of the data in the database, so that the amount of data in the index is greatly reduced. At the same time, the data can be filtered according to the needs of use, which makes the use efficiency of the index significantly improved. Especially when the data that needs to be indexed is big data, the method provided by the present invention has more advantages in terms of creation efficiency and the like.

In addition, because of the redundant table data being filtered, the speed at which users access the database through the index is improved. The maintenance cost of the index is also reduced. After the index is reduced, the operation of adding and deleting data becomes simple; the speed of creating the index is improved, the difficulty is reduced, and the time is reduced, making it easier for the user to create a new index according to his needs.

In a specific embodiment, the data filtering condition is obtained by analyzing a creation instruction sent by the user in a SQL manner, and the foregoing step 101 may include:

Receiving a SQL instruction that the user creates an index;

Parsing the SQL instruction that creates the index, and obtaining a data filtering condition from the SQL instruction that creates the index.

2 is an implementation of the step of filtering the target table data according to the data filtering condition to obtain table data satisfying the data filtering condition, and creating an index for the target table data satisfying the data filtering condition according to the data filtering condition. Referring to FIG. 1, in a specific embodiment, the foregoing step 102 can also be implemented by the process shown in FIG. 2, including the following steps: Step 201: Read target table data in the database.

As an embodiment, the target table data refers to table data in a data table related to an index in a database.

Step 202: Determine whether the target table data satisfies the data filtering condition. When the result of the determination is yes, step 203 is performed; when the result of the determination is no, step 205 is performed.

As an embodiment, when it is determined whether the target table data satisfies the data filtering condition, if it is determined that the data filtering condition is not satisfied, it is not required to create an index on the target table data. Step 203: Perform calculation on the table data that satisfies the filtering condition to obtain index data. Step 204: Write the index data to the position of the corresponding pointer on the index.

Step 205: Determine whether the index is created. When the result of the determination is yes, the operation ends; when the result of the determination is no, the process returns to step 201.

Here, in the case where the index data is sequentially calculated for the target table data satisfying the data filtering condition in the target data table, after each calculation, if it is determined that there is remaining, unread data in the target data table, You can see that the index has not been created yet. In the present embodiment, the target data table refers to a data table corresponding to the target table data. If it is determined in step 205 that the index has been created, the operation ends.

Referring to Figures 1 and 2, in some embodiments, to implement step 102, a flow including at least steps 201 through 204 should be performed.

In some embodiments, the data filtering condition includes a data filtering condition included in a user create index command. Specifically, the data filtering condition includes: obtaining a data filtering condition from a SQL statement corresponding to the user creating an index command.

Specifically, the data filtering condition includes a data filtering condition that reflects a user operation requirement; and the data filtering condition may be used by analyzing a possible operation when the user creates an index on the target data table, from the SQL statement corresponding to the operation. Obtain and delete the same data filtering conditions contained in different SQL statements to obtain multiple different or one data filtering conditions required to create an index.

In real life, data has a certain life cycle. Usually, users operate on newer data more frequently, and the data operations that are older are less. Under the existing database technology conditions, in order to meet the execution efficiency requirements, the database developer divides the same table into an online table and a history table; the online table stores the latest small amount of data, and the remaining data is stored in the history table. The data migration from the online table to the history table has a large workload, and the entire process consumes a large amount of system input and output (10) and CPU. In this regard, in some embodiments of the present invention, when the target table data is big data, the data filtering condition includes: selecting, from the grouping of the table data according to the data life cycle, the index used to create the index The selection criteria on which the target group is based.

When the R&D personnel develops, the data in the big data target data table is grouped according to the data life cycle; then, in this embodiment, at least one group is selected from the data group as the target group according to the data filtering condition, and the data filtering is satisfied. Table data for conditions. The data filtering condition includes a filtering condition upon which a target group is selected from the at least one group.

Specifically, when grouping the data in the at least one target data table, the data table structure can be analyzed to find a field that can be used as a time axis, and the fields are formed into a time axis, and the table data is obtained according to the time axis in the life cycle. In the stage, the table data in the database is divided. More specifically, it can be divided into "days".

After grouping the big data tables, according to the data filtering conditions obtained by analyzing the user operation requirements, at least one of the groups is selected as the target group, and an index is created for the target group, and the selection condition of the target group includes data filtering in creating the index. In the condition. Such data filtering conditions are added to the SQL statement that creates the index, and finally the index of the target table data is created according to the SQL statement that creates the index.

The data grouping method used in the prior art often separates data in the same time period. For example, the hotspot data and the non-hotspot data are separated, and an index is separately created. However, the data index structure of the same time phase is basically the same, for example, the index structure of the hotspot data and the non-hotspot data is substantially the same, and the method provided by the above embodiment of the present invention can be made from the data in the database according to the data life cycle. Selecting the target group in the grouping, obtaining the table data satisfying the filtering condition, and establishing the corresponding index, is advantageous for creating a unified index for different types of data with the same index structure, and thus has higher efficiency in the process of processing big data.

The above analysis of the user requirements may be an analysis of the query conditions in the corresponding SQL query statement when the user accesses the database. According to the method provided by the embodiment of the present invention, the database R&D personnel determines the screening condition of the index according to the actual needs, establishes the corresponding index, and eliminates the need to separate the hot and cold data from the table, and no data migration. Database design will be more reasonable.

For data in different time ranges, users have different operational requirements and need to modify the index accordingly. In this regard, in other embodiments of the present invention, the data index creation method provided by the embodiment of the present invention further includes: managing the index at different stages of the table data life cycle: according to the target table data in the data life cycle The corresponding phase changes, the index is changed. Specifically, for example, the index established on the status field is often used to query the operation status and update; if the historical data is not updated, the index on the status field is no longer needed, and the corresponding index data needs to be deleted. For another example, if the user no longer cares about the overdue data for more than one year, the index before the one-year range needs to be deleted.

In some embodiments, the data filtering condition is implemented by a where statement.

In the current SQL syntax, where is an instruction in the database that specifies the conditions for selection, and is applied to select (select), delete (delete), and update (update) statements. In the embodiment of the present invention, in the statement for creating an index, the data filtering condition is implemented by the where statement; that is, the target table data is filtered by executing the corresponding where statement.

More specifically, the where statement includes a where instruction and a conditional expression. The conditional expression can be a combination of columns, constants, and operators.

Preferably, the where statement can be set at the end of the current SQL creation index statement. In order to avoid the negative effects of the use of the where statement by the database developer, in some embodiments of the invention, the data filtering condition is implemented by a statement containing a range of words. The range word may be a range instruction, a before instruction, or the like.

In order to avoid the negative effects of the use of the where statement by the database developer, in some embodiments of the invention, the data filtering condition is also implemented by a statement containing a list of words. The list word can be a list instruction. The embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the data index creation method according to the embodiment of the present invention.

3 is a flowchart of a data index creation method according to a preferred embodiment of the present invention. In a preferred embodiment of the present invention, the data index creation method includes the steps shown in FIG. 3: Step 301: Receive user creation Indexed instructions.

Here, the instruction to create an index may be an SQL instruction that creates an index.

Step 302: Obtain a data filtering condition from the instruction for creating an index.

Step 303: Read the target table data. As an embodiment, the target table data refers to table data in a database corresponding to an instruction to create an index.

Step 304: Determine whether the target table data satisfies the data filtering condition; when the result of the determination is yes, execute step 305; when the result of the determination is no, perform step 307.

Step 305: Calculate the target table data to obtain index data.

Step 306: Write the index data to a corresponding pointer position on the index.

Step 307: Determine whether there is unread target table data in the database; when the result of the determination is yes, the operation flow is ended; when the result of the determination is no, the process returns to step 303.

The embodiment of the present invention further provides a data index creation device, and FIG. 4 is a schematic structural diagram of a data index creation device according to an embodiment of the present invention; as shown in FIG. 4, the device includes:

The data filtering condition obtaining module 41 is configured to obtain a data filtering condition;

The index creation module 42 is configured to select, according to the data filtering condition acquired by the data filtering condition obtaining module 41, the target table data to obtain table data that satisfies the data filtering condition, and satisfy the data filtering condition. The table data creates an index. The data index creation device provided by the embodiment of the present invention filters the target table data according to certain data filtering conditions when the index is created, and filters the target table data that does not satisfy the data filtering condition, and only uses the data filtering condition to the database. The target table data is filtered to obtain table data satisfying the data filtering condition, and an index is created for the table data satisfying the data filtering condition, so that the amount of data in the index is greatly reduced. The smaller the target data volume ratio of the data that satisfies the data filtering condition, the more obvious the index creation device provided by the embodiment of the present invention improves the speed of index creation; especially when facing massive data, the device provided by the present invention can be faster. Speed creates an index. At the same time, according to the index created by the filter conditions, the efficiency of the entire index is also significantly improved.

The data filtering condition can be obtained by analyzing a creation instruction sent by the user in SQL, or by analyzing user operation requirements.

If the data filtering condition is obtained by analyzing the creation instruction sent by the user in the SQL manner, the data filtering condition obtaining module 41 may further include:

The instruction receiving unit 411 is configured to receive an instruction for the user to create an index;

The create instruction analysis unit 412 is configured to acquire a data filter condition from the instruction to create the index received by the create instruction receiving unit 411.

Referring to FIG. 4, in some embodiments, the index creation module 42 further includes: a table data reading unit 421 configured to read target table data in the database;

The data filtering condition determining unit 422 is configured to determine whether the target table data read by the table data reading unit satisfies the data filtering condition, and trigger the calculating unit when the target table data satisfies the data filtering condition 423 ;

The calculating unit 423 is configured to calculate target data that meets the data filtering condition to obtain index data.

The index data writing unit 424 is configured to write the index data obtained by the calculating unit 423 to the position of the corresponding pointer on the index. Referring to FIG. 4, the index creation module 42 further includes a data discriminating unit 425 configured to, in the case of batch processing of the target table data, write the index data to the corresponding pointer on the index at the index data writing unit 424. After the location, it is judged whether the entire index is created, and if the entire index is not created, the table data reading unit 421 is triggered to continue to read the target table data in the database.

In some embodiments, the data filtering condition may include a data filtering condition included in a user create index command.

In other embodiments, the data filtering conditions can be obtained from analyzing user operational requirements to creating indexing instructions. Specifically, the data filtering condition obtaining module 41 is configured to obtain a data filtering condition by using an SQL command that creates an index.

Specifically, the data filtering condition includes a data filtering condition that reflects a user operation requirement; the data filtering condition may be obtained by analyzing a possible query, update, and delete operation of the target table data by the user, and obtaining the SQL statement corresponding to the operation. Delete the same data filtering conditions contained in different SQL statements, obtain the main filtering conditions for the user to operate on the table, and then comprehensively consider the performance and other aspects, and finally get multiple different or ones needed to create the index. Data filtering conditions.

In some embodiments, the target table data is all data in the data table.

In some embodiments, the data is big data, and the data filtering conditions include: selecting, from the grouping of the table data according to the data life cycle, a selection condition according to the target group used to create the index.

Specifically, when grouping the data in the big data table, according to analyzing the user operation The data grouping conditions obtained by the requirements, analyze the data table structure, find the fields that can be used as the time axis, form these fields into the time axis, obtain the stage of the table data in the life cycle according to the time axis, and the table data in the database. Divided into multiple groups. More specifically, it can be divided by day.

After grouping the big data, one or more of the groupings may be selected as the target group according to the data filtering conditions obtained by analyzing the user operation requirements, and the selection condition of the target group is the data filtering condition. Such data filtering conditions are added to the SQL statement that creates the index, and finally the index of the target table data is created according to the SQL statement that creates the index.

In some embodiments, the data filtering condition is implemented by a where statement, or by a statement containing a range of words, or by a statement containing a list of words.

In a preferred embodiment of the present invention, the big data indexing device includes a data filtering condition acquisition module and an index creation module.

The data filtering condition obtaining module 41 is configured to acquire a data filtering condition; the data filtering condition obtaining module 41 includes:

Creating an instruction receiving unit configured to receive an instruction for the user to create an index;

The creation instruction analysis unit is configured to acquire a data filter condition from the instruction to create an index received by the creation instruction receiving unit 411.

The index creation module 42 is configured to: select, according to the data filtering condition, the target table data to obtain the table data that meets the filtering condition, and create an index on the table data that meets the data filtering condition; the index creating module 42 includes:

The table data reading unit 421 is configured to read the target table data; as an embodiment, the target table data refers to table data in a database corresponding to the instruction for creating an index;

The data filtering condition determining unit 422 is configured to determine whether the target table data read by the table data reading unit 421 satisfies the data filtering condition, and trigger a calculation when the target table data satisfies the data filtering condition. Unit 423; The calculating unit 423 is configured to calculate the target table data that satisfies the data filtering condition, to obtain index data;

The index data writing unit 424 is configured to write the index data obtained by the calculating unit 423 into a corresponding pointer position on the index;

The data discriminating unit 425 is configured to determine, after the index data writing unit 424 writes the index data to the position of the corresponding pointer on the index, whether the index is created, and an unread target table exists in the database. In the case of data, the table data reading unit 421 is triggered to continue reading the target table data in the database.

In the embodiment of the present invention, the network abnormality detecting processing device may be implemented by a database in an actual application; the data filtering condition acquiring module 41 and its submodules in the device: a create instruction receiving unit 411 and a create command analyzing unit 412. The index creation module 42 and its sub-modules: a table data reading unit 421, a data filtering condition determining unit 422, a calculating unit 423, an index data writing unit 424, and a data discriminating unit 425, which may be used by the device in practical applications. The central processing unit (CPU), the digital signal processor (DSP) or the Field Programmable Gate Array (FPGA).

As can be seen from the above, the data index creation device provided by the embodiment of the present invention has a small amount of index data and a high usage rate, which can improve the speed of the user accessing the database through the index, and can also reduce the maintenance of the index. Cost, making index updates easier. In addition, the data index creation device provided by the embodiment of the present invention manages data according to the big data life cycle, which helps improve the rationality of the database design.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the present invention is applicable to one or more computer-usable storage media (including but not limited to disks) having computer usable program code embodied therein. A form of computer program product embodied on a memory and optical storage, etc.).

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus, and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowcharts and/or block diagrams, and combinations of flow and/or blocks in the flowcharts and/or block diagrams can be implemented by computer program instructions. The computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing device to produce a machine such that a process or a process and/or a block diagram of a block or A device that has multiple functions specified in the box.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only an embodiment of the present invention. It should be noted that those skilled in the art can make some improvements and refinements without departing from the principles of the embodiments of the present invention. Retouching should also be considered as the scope of protection of the embodiments of the present invention. Industrial applicability

In the embodiment of the present invention, when the index is created, the target table data is filtered according to certain data filtering conditions, and the target table data that does not satisfy the data filtering condition is filtered out, and only an index is created for a part of the data in the database, so that the data in the index The amount will be reduced to a large extent and will not be basically The target table data is filtered out of the index, which makes the use efficiency of the index significantly improved, and the speed at which the user accesses the database through the index is improved.

Claims

claims

1. A data index creation method, including the following steps:

Get data filter conditions;

According to the data filtering conditions, the target table data is selected to obtain table data that satisfies the data filtering conditions, and an index is created for the table data that satisfies the data filtering conditions.

2. The method according to claim 1, wherein, according to the data filtering conditions, selecting target table data to obtain table data that satisfies the data filtering conditions, and selecting table data that satisfies the data filtering conditions. Create indexes, including:

Read the target table data in the database;

When it is determined that the target table data satisfies the data filtering conditions, calculate the target table data that satisfies the data filtering conditions to obtain index data;

3. The method according to claim 2, wherein after writing the index data to the position of the corresponding pointer on the index, the method further includes:

Determine whether the index has been created, and obtain the judgment result; when the judgment result is that the index has been created, end the operation; when the judgment result is that the index has not been created, re-read the target table data in the database, When it is determined that the target table data satisfies the data filtering condition, the target table data satisfying the data filtering condition is calculated to obtain index data; and the index data is written into the position of the corresponding pointer on the index.

4. The method according to claim 1, wherein the obtaining data filtering conditions is: obtaining the data filtering conditions through a structured query language SQL command that creates an index.

5. The method according to claim 4, wherein when the target table data is big data, the data filtering conditions include: from the grouping of the target table data according to the data life cycle, select to create The selection criteria based on which to target the index.

6. The method according to claim 4, wherein the data filtering condition passes where Statement implementation, either by statements containing range words, or by statements containing list words.

7. A data index creation device, including:

The data filter condition acquisition module is configured to obtain data filter conditions;

The index creation module is configured to filter the target table data according to the data filtering conditions obtained by the data filtering condition acquisition module to obtain table data that satisfies the data filtering conditions, and select table data that satisfies the data filtering conditions. Create index.

8. The device according to claim 7, wherein the index creation module includes: a table data reading unit configured to read target table data in the database;

A data filtering condition judgment unit configured to judge whether the target table data read by the table data reading unit satisfies the data filtering condition, and trigger the calculation unit when the target table data satisfies the data filtering condition;

A calculation unit configured to calculate target table data that meets the data filtering conditions to obtain index data;

An index data writing unit is configured to write the index data obtained by the calculation unit into the position of the corresponding pointer on the index.

9. The device according to claim 8, wherein the index creation module further includes a data determination unit configured to determine after the index data writing unit writes the index data to the position of the corresponding pointer on the index. Whether there is unread table data in the database, and when the index has not been created, the table data reading unit is triggered to continue reading the target table data in the database.

10. The device according to claim 7, wherein the data filtering condition acquisition module is configured to obtain data filtering conditions through a structured query language SQL command that creates an index.

11. The device according to claim 10, wherein the target table data is big data, and the data filtering conditions include, from the grouping of table data according to the data life cycle, Selection criteria based on which target group to create the index.

12. The device according to claim 10, wherein the data filtering condition is implemented by a where statement, or a statement containing a range word, or a statement containing a list word.

13. A computer storage medium, the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the data index creation method according to any one of claims 1 to 6.