WO2020238546A1

WO2020238546A1 - Kv database configuration method, query method, device and storage medium

Info

Publication number: WO2020238546A1
Application number: PCT/CN2020/087827
Authority: WO
Inventors: 王志文; 吴思进
Original assignee: 杭州复杂美科技有限公司
Priority date: 2019-05-31
Filing date: 2020-04-29
Publication date: 2020-12-03
Also published as: CN110175176A; US20220374406A1

Abstract

A KV database configuration method, a query method, a device, and a storage medium, wherein the method comprises: taking unique index data of a first data table as a key value, taking a plurality of common index data as value value, and storing the first data table into a data storage area (S11); taking first index information generated according to the first data in the first data table as the key value, taking the unique index data of the first data as the value value, and generating a plurality of index data pairs and storing the index data pairs into the index storage area (S12); wherein, the first index information comprises the name of the first index, and the index data of the first index in the first data. The method realizes automatically storing all relational data in the data table into the kv database, greatly simplifies the workload of manually constructing the kv, and meanwhile, a common kv database can also achieve the effect of a relational database.

Description

KV database configuration method, query method, equipment and storage medium

Technical field

This application relates to the field of information storage technology, and specifically relates to a KV database configuration method, query method, equipment and storage medium.

Background technique

At present, the KV database is a non-relational database, which is not suitable for business data storage involving some data relational services. Currently, there are solutions for KV databases in the industry to implement relational databases, such as using TiKV's TiDB database, but this kind of database is generally It is customized to meet the needs of developers for certain data relationships. It is difficult to use this database to query non-customized ordinary relationship data.

Summary of the invention

In view of the above-mentioned shortcomings or deficiencies in the prior art, it is desirable to provide a universal KV database configuration method, query method, equipment and storage medium.

In the first aspect, the present invention provides a KV database configuration method, including:

Use the unique index data of the first data table as the key value and several ordinary index data as the value value, and store the first data table in the data storage area;

Using the first index information generated according to the first data in the first data table as the key value, and the unique index data of the first data as the value value, generating several index data pairs and storing them in the index storage area;

Wherein, the first index information includes the name of the first index and index data of the first index in the first data.

Further, the first index information also includes unique index data of the first data.

Further, when there is no unique index data in the first data table, the unique index data is automatically configured for the first data table.

Further, the unique index data is a fixed number of bits. If it is not satisfied, zeros are added before the unique index data to satisfy the number of bits.

Further, the method also includes:

Generate association tables of several data tables according to several data tables; among them, the association table includes index data combinations of several data tables, and each unique index data corresponding to the index data combinations in the several data tables.

In the second aspect, the present invention provides a kv database query method, which is suitable for single-table query, and is characterized in that the method includes:

Generate the first query index data according to the first information query content information, and determine whether the first query index data is the same as the unique index data:

If yes, query based on the unique index data storage area to generate query results;

Otherwise, query the index storage area according to the first query index data to generate the query result.

In a third aspect, the present invention provides a kv database query method, which is suitable for querying related tables, and is characterized in that the method includes:

Generate second query index data according to the second information query content, and obtain several index data in the association table according to the second query index data;

Obtain the required data information in the corresponding data tables according to the index data.

In a fourth aspect, the present invention also provides a device that includes one or more processors and a memory, where the memory contains instructions executable by the one or more processors to make the one or more processors execute each of the processors according to the present invention. The kv database configuration method and query method provided by the embodiment.

In the fifth aspect, the present invention also provides a storage medium storing a computer program, which causes the computer to execute the kv database configuration method and query method provided according to the embodiments of the present invention.

The beneficial effects of the present invention

A KV database configuration method, query method, device and storage medium provided by many embodiments of the present invention store data in a data storage area by using unique index data of a data table as a key value and several ordinary index data as value values; The first index information in the data table is used as the key value, and the unique index data of the first data is used as the value value. Several index data are generated and stored in the index storage area, so as to realize the automatic operation of all relational data in the data table. Stored in the kv database greatly simplifies the workload of manually constructing the kv, and at the same time enables the ordinary kv database to achieve the effect of the relational database, and realizes the query of all data relationships through the kv database database.

Description of the drawings

By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the present application will become more apparent:

FIG. 1 is a schematic diagram of a user data table provided by an embodiment of the present invention.

Figure 2 is a flowchart of a kv database configuration method provided by an embodiment of the present invention.

Fig. 3 is a schematic diagram of a scenario of a preferred embodiment of the method shown in Fig. 2.

Fig. 4 is a schematic diagram of a preferred embodiment of the method shown in Fig. 2.

Fig. 5 is a flowchart of a preferred embodiment of the method shown in Fig. 2.

FIG. 6 is a schematic diagram of a scenario of a preferred embodiment of the method shown in FIG. 5.

Fig. 7 is a flowchart of a kv database query method provided by an embodiment of the present invention.

FIG. 8 is a flowchart of a kv database query method provided by another embodiment of the present invention.

FIG. 9 is a schematic structural diagram of a device provided by an embodiment of the present invention.

Detailed ways

The application will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described here are only used to explain the related invention, but not to limit the invention. In addition, it should be noted that, for ease of description, only the parts related to the invention are shown in the drawings.

It should be noted that the embodiments in the application and the features in the embodiments can be combined with each other if there is no conflict. Hereinafter, the present application will be described in detail with reference to the drawings and in conjunction with embodiments.

Fig. 1 is a schematic diagram of a user data table provided by an embodiment of the present invention. As shown in Figure 1, in a preferred embodiment, the id in the table is used as the unique index primary of the table, and the corresponding 1, 2, 3, etc. under the id are the unique index data of the table; the unique index data represents The data that is not repeated with the data in the user data table corresponds to the rows in the user data table one-to-one, and the name, address, gender, etc. are ordinary index indexes, and the corresponding data below are ordinary index data.

As shown in Figure 2, in this embodiment, the present invention provides a kv database configuration method, including:

S11. Use the unique index data of the first data table as a key value and several ordinary index data as value values, and store the first data table in a data storage area;

S12. Use the first index information generated according to the first data in the first data table as the key value, and use the unique index data of the first data as the value value to generate several index data pairs and store them in the index storage area in;

Wherein, the first index information includes the name of the first index, and index data of the first index in the first data.

Specifically, as shown in Figure 3, taking the data table shown in Figure 1 as an example, the id in the user data table is used as the unique index, and the unique index data primaryid:1 is used as the key value of the kv database, and the id is 1 The other data in this row is processed as the value value of the kv database. The processing method of the other data in this row is the existing processing technology. The generated key-value data is stored in the data storage area; the name is used as a common index, then name:Lucy as the key value, primaryid:1 as the value value; similarly, if address is used as a common index, address:Lucy as the key value, primaryid:1 as the value value, and gender as the common index index, then gender:Lucy as the value The key value, primaryid:1 is the value value, and the above-mentioned ordinary index data is stored in the index storage area; in this way, all the data with id 1 has been automatically stored in the kv database.

The same principle is to store the data with id 2 in the kv database, and store the data with id 3 in the kv database...

In more embodiments, the definition of the key value can also add other content that can identify the data table on the basis of the above. For example, the above user table can be represented by userprimaryid:1, username:Lucy, useraddress:Lucy, and the game table (b The common index of the row where the id is a in) can be represented by gamename: game 1, gamestatus: open, and is not limited by the foregoing embodiment.

The above embodiment realizes relational data by generating corresponding key values and value values for different data in the data table according to their corresponding configuration methods, and storing the generated key values and value values in corresponding storage areas. The content of this can automatically store all relational data in the kv database, which greatly saves all the costs of manually storing the data relationships in the data table in the kv database, and improves the efficiency of work. At the same time, all the data in this method All of the data relationships can be stored in the kv database without omission, and it is more reliable and convenient for data query to obtain the required data.

Fig. 4 is a schematic diagram of a preferred embodiment of the method shown in Fig. 2. As shown in FIG. 4, the first index information described in the above method also includes unique index data of the first data.

Specifically, as shown in FIG. 4, the first index information also includes unique index data, that is, the unique index is id1, and the first index information whose common index is name also includes primaryid:1, and the corresponding key is name:Lucy: primaryid:1, the key corresponding to the common index address is address:Lucy:primaryid:1, the key corresponding to the common index gender is gender:Lucy:primaryid:1; similarly, the key and value of the common index whose unique index is id2 The generation method is the same as above, so I won't repeat it here.

In the above embodiment, by adding the corresponding unique index data to the first index information, the data content is not redundant. Even if there is the same index data content, the generated first index information is also different because the unique index data is different. Will not be the same, have uniqueness.

In more embodiments, in addition to the unique index data, the first index information can also be 1, 2, 3, A, B, C, a, b, c... such data information as long as the first index The index information only needs to be unique in the data table, and the specific content is not limited by the foregoing embodiment.

Further preferably, when there is no unique index data in the first data table, the first data table is automatically configured with unique index data, that is, if the data is not unique in the data table, the system will automatically assign unique index data to the data table , Such as according to the

serial number

1, 2, 3 and other numbers, can also be allocated according to letters such as A, B, C, or any combination of these data, as long as it can be unique in the table.

Furthermore, the unique index data is a fixed number of digits. If it is not satisfied, zeros should be added before the unique index data to meet the number of digits; specifically, as shown in the data table shown in Figure 1, the number under id is 1, 2, 3……Wait, in the kv database, we set the number of unique index data to 20 digits. If it is not 20 digits, add zeros in the front. For example, after 1 is completed, it is 00000000000000000001, 2 is 00000000000000000002, ... 10 is 00000000000000000010 ,11 is 00000000000000000011.

Fig. 5 is a flowchart of a preferred embodiment of the method shown in Fig. 2. As shown in FIG. 5, in a preferred embodiment, the above method further includes: S13. Generating association tables of several data tables according to several data tables; wherein the association table includes index data combinations of several data tables, and the index data combination is Each unique index data corresponding to several data tables.

Specifically, as shown in Figure 6, taking the user table (a) and game table (b) shown in Figure 1 as an example, the relationship between gender in the user table and name in the game table is stored in the database , The storage mode of the association table (a) is the same as that shown in Fig. 2, and will not be repeated here. In the same way, the user table (a) shown in FIG. 1 and other relations in the game table (b) can also be linked to generate several other association tables.

Fig. 7 is a flowchart of a kv database query method provided by the present invention. As shown in Fig. 7, a kv database query method, the database is generated by the method shown in Fig. 4, the method is suitable for single-table query, and is characterized in that the method includes:

S21: Generate first query index data according to the first information query content information, and determine whether the first query index data is the same as the unique index data:

If not, query the index storage area according to the first query index data to generate the query result.

Specifically, if you need to query all data of Lucy, construct the first query index data: name: Lucy, and determine whether the data is unique index data, if not, use the first query index data name: Lucy to search the index storage area , The query path is name:Lucy:primaryid:1→primaryid:1, after obtaining primaryid:1, go to the data storage area to obtain all the data about Lucy (Lucy, abc, female). If you need to query all the data with id 1, after constructing the first query index data based on the query data, it is judged that the data is unique index data, and then the data is directly queried in the data storage area, the query path is primaryid:1→ Lucy, abc, female.

Figure 8 is a flowchart of another kv database query method provided by the present invention. As shown in Figure 8, a kv database query method. The database is generated by the method shown in Figure 5. The method is suitable for querying related tables, and is characterized in that the method includes:

S31. Generate second query index data according to the content of the second information query, and obtain a number of index data in the association table according to the second query index data;

S32: Obtain the required data information in each corresponding data table according to each index data.

Specifically, such as querying the relevant data information of playing game 1 among women, as shown in Figure 6, the second query index data is generated according to "女#游戏1", and the corresponding key value is obtained in the index storage area according to the corresponding key value. value value, and obtain primaryuserid:1, then query game:a according to primaryuserid:1, and then query the required data in the kv database of game table (Figure 1b) according to game:a.

The above method is also suitable for querying multiple union tables, and the construction principle is the same as the above method, so it will not be repeated here.

As shown in Figure 7, as another aspect, the present application also provides a device 700, including one or more central processing units (CPU) 701, which can be based on a program stored in a read-only memory (ROM) 702 or The program loaded from the storage section 708 into the random access memory (RAM) 703 executes various appropriate actions and processing. In the RAM 703, various programs and data required for the operation of the device 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704.

The following components are connected to the I/O interface 705: an input part 706 including a keyboard, a mouse, etc.; an output part 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part 708 including a hard disk, etc. ; And a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. The drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that the computer program read therefrom is installed into the storage section 708 as needed.

In particular, according to the embodiments of the present disclosure, the kv database configuration method and query method described in any of the above embodiments can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program tangibly contained on a machine-readable medium, and the computer program includes program code for executing a kv database configuration method and a query method. In such an embodiment, the computer program may be downloaded and installed from the network through the communication part 709, and/or installed from the removable medium 711.

As yet another aspect, the present application also provides a computer-readable storage medium. The computer-readable storage medium may be the computer-readable storage medium included in the device of the above-mentioned embodiment; or it may exist alone without being installed in The computer-readable storage medium in the device. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the kv database configuration method and query method described in this application.

The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.

The units or modules involved in the embodiments described in the present application can be implemented in software or hardware. The described units or modules may also be arranged in the processor. For example, each of the described units may be a software program arranged in a computer or a mobile smart device, or may be a separately configured hardware device. Among them, the names of these units or modules do not constitute a limitation on the units or modules themselves under certain circumstances.

The above description is only a preferred embodiment of the application and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover the above technical features or technical solutions without departing from the concept of the application. Other technical solutions formed by any combination of its equivalent features. For example, the above-mentioned features and the technical features disclosed in this application (but not limited to) with similar functions are mutually replaced to form a technical solution.

Claims

A KV database configuration method is characterized in that it includes:

Using the unique index data of the first data table as the key value and several ordinary index data as the value value, and storing the first data table in the data storage area;

Using the first index information generated according to the first data in the first data table as a key value, and using the unique index data of the first data as a value value, generating several index data pairs and storing them in the index storage area;

Wherein, the first index information includes the name of the first index, and index data of the first index in the first data.
The method according to claim 1, wherein the first index information further includes unique index data of the first data.
The method according to claim 1 or 2, wherein when the unique index data is not in the first data table, the unique index data is automatically configured for the first data table.
The method according to claim 3, characterized in that, the method according to claim 1 or 2, characterized in that the unique index data is a fixed number of bits, if not satisfied, the unique index data Padded zeros to meet the number of digits.
The method according to claim 4, further comprising:

The association table of the several data tables is generated according to the several data tables; wherein the association table includes the index data combination of the several data tables, and each unique index corresponding to the index data combination in the several data tables data.
A kv database query method, the method is based on the kv database configured according to the method of claim 2, the method is suitable for single-table query, and is characterized in that the method includes:

Generate first query index data according to the first information query content information, and determine whether the first query index data is the same as the unique index data:

If yes, query according to the unique index data storage area to generate query results;

If not, query the index storage area according to the first query index data to generate a query result.
A method for querying a kv database, the method is based on a kv database generated according to the method of claim 5, and the method is suitable for querying an association table, wherein the method includes:

Generate second query index data according to the content of the second information query, and obtain a number of index data in the association table according to the second query index data;

According to the index data, the required data information is obtained from the corresponding data tables.
A device, characterized in that the device includes:

One or more processors;

Memory, used to store one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the method according to any one of claims 1-7.
A storage medium storing a computer program, wherein the program is executed by a processor to implement the method according to any one of claims 1-7.