CN111259003A

CN111259003A - Database establishing method and device

Info

Publication number: CN111259003A
Application number: CN202010016078.8A
Authority: CN
Inventors: 张良
Original assignee: Guangzhou Huya Technology Co Ltd
Current assignee: Guangzhou Huya Technology Co Ltd
Priority date: 2020-01-07
Filing date: 2020-01-07
Publication date: 2020-06-09
Anticipated expiration: 2040-01-07
Also published as: CN111259003B

Abstract

The embodiment of the application provides a database establishing method and a device, which relate to the field of databases, and the method comprises the following steps: acquiring a data identifier and a sequencing attribute value set of data to be stored; generating sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set; and sequencing and storing the sequencing data according to a preset sequencing and storing scheme to obtain a database with a specific data sequence. Therefore, the implementation of the implementation mode can solve the problem of poor query effect when the data volume is large, and can be applied to a high-concurrency data query scene.

Description

Database establishing method and device

Technical Field

The application relates to the technical field of databases, in particular to a database establishing method and device.

Background

With the rapid development of science and technology, more and more technologies can be realized through a computer; as is known, computer-implemented technologies typically require a large amount of data support, which necessitates the building of a database. At present, the establishment mode of a database is usually sequential storage, so that the database data needs to be reordered in the data query process, and the result that the query effect is worse when the data volume is larger is caused; on the other hand, the number of concurrent queries simultaneously supported by the current database is small, and the method cannot be applied to a high-concurrency data query scene.

Disclosure of Invention

The embodiment of the application aims to provide a database establishing method and a database establishing device, the database established by the database establishing method and the database establishing device can solve the problem of poor query effect when the data volume is large, and can be applied to a high-concurrency data query scene.

A first aspect of an embodiment of the present application provides a database establishment method, where the method includes:

acquiring a data identifier and a sequencing attribute value set of data to be stored;

generating sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set;

and sequencing and storing the sequencing data according to a preset sequencing and storing scheme to obtain a database with a specific data sequence.

In the implementation process, the database establishing method can preferentially acquire a large amount of data to be stored, and simultaneously acquire a data ID and a sorting attribute value set corresponding to each data to be stored, wherein the sorting attribute value set comprises a plurality of sorting attribute values, and a priority order of sorting is existed among the plurality of sorting attribute values; after the data identification and the sorting attribute value set of the data to be stored are obtained, the data ID and the sorting attribute value set are preprocessed, so that the preprocessed structure conforms to a preset data storage structure, the data storage structure can adapt to a preset sorting storage scheme, sorting storage of the data is facilitated, and a database with a specific data sequence is obtained. Therefore, by implementing the implementation mode, the sequencing data which accord with the data storage structure can be obtained by preprocessing the data to be stored, so that the finally established database is constructed based on the sequencing data, the database can be orderly constructed through the corresponding sequencing of the data in the database, the problem of poor query effect when the data volume is large can be solved in the using process of the database, and the method can be applied to a high-concurrency data query scene.

Further, the method further comprises:

generating mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identification and the sequencing attribute value set;

and storing the mapping data according to a preset mapping storage scheme to obtain a data table for inquiring the data identification and the sequencing attribute value set.

In the implementation process, after the database is obtained, the method can also process the data identifier and the sorting attribute value set to obtain mapping data which accords with a preset mapping storage structure, wherein the mapping data is used for representing the mapping relation between the data identifier and a set of sorting attribute values except a top sorting attribute value in the sorting attribute value set; after the mapping data is obtained, extracting a corresponding mapping storage instruction in a preset mapping storage scheme, so that the mapping data can be nested into the mapping storage instruction, and the mapping storage instruction can store the mapping data into a preset data table, wherein the data table is used for inquiring the data identification and the sorting attribute value set. Therefore, by implementing the implementation mode, the mapping relation of the stored data ID and the sequencing data can be further established after the database is established so as to support the query of the data set (the data table) of the serial number of the single data, so that after the database is established, a better query effect can be achieved in the query of the single data, thereby being beneficial to improving the use and use effect of the database and enriching the use and use of the database.

Further, the step of generating the sorting data conforming to the data storage structure according to a preset data storage structure, the data identifier and the sorting attribute value set includes:

acquiring a database number corresponding to the data identifier;

acquiring a first ordering attribute value included in the ordering attribute value set;

generating an ordering array according to the data identification and the ordering attribute value set;

and substituting the database number, the head ordering attribute value and the ordering array as structure parameters into a preset data storage structure to obtain ordering data conforming to the data storage structure.

In the implementation process, to acquire the sequencing data, the database numbers corresponding to the data identifiers can be preferentially acquired, so that the data identifiers are all stored in the same database; then, acquiring a first ordering attribute value included in the ordering attribute value set, and confirming the first ordering attribute value as an attribute value with the highest data ordering priority in the database; then, generating a sorting array according to the data identifier and the sorting attribute value set, wherein the sorting array does not include the head sorting attribute value, and the data identifier is arranged at the tail end of the sorting attribute value set except the head sorting attribute value and is used for representing the mapping relation between the sorting attribute value set except the head sorting attribute value and the data; and finally, substituting the database number, the first-order sorting attribute value and the sorting array as structure parameters into a preset data storage structure to obtain sorting data conforming to the data storage structure, wherein the structure parameters are several parameters included in the data storage structure, and the substitution means corresponding replacement. Therefore, by implementing the implementation mode, corresponding specific data can be correspondingly acquired according to various structural parameters included by the data storage structure, so that the data storage structure can obtain effective sequencing data after the specific data are filled, the sequencing data can be acquired more accurately and effectively, the orderliness of the data in the database can be further improved through the sequencing data of the data storage structure, the ordered and stable database establishment is facilitated, and the improvement of the use convenience of subsequent query is facilitated.

Further, the step of performing sorting storage on the sorted data according to a preset sorting storage scheme to obtain a database with a specific data sequence includes:

calling a database storage instruction according to a preset sequencing storage scheme;

and sequencing and storing the sequencing data according to the database storage instruction to obtain a database with a specific data sequence.

In the implementation process, the method calls a database storage instruction according to a preset sorting storage scheme preferentially in the process of finally establishing the database, wherein the database storage instruction can be a data information input instruction; after the database storage instruction is obtained, the method can embed the sorting data into the database storage instruction to obtain an instruction with sorting storage information, so that the sorting storage information (namely sorting data) is input into the database corresponding to the database number through the instruction, and the database with a specific data sequence is established. Therefore, by implementing the implementation mode, the sequencing data can be orderly stored in the database through the database storage instruction, so that the database has corresponding sequencing in the establishing process, the problem of poor query effect when the data volume is large is solved, and meanwhile, the method can be applied to a high-concurrency data query scene.

Further, the step of generating mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identifier and the sorting attribute value set includes:

acquiring a data number corresponding to the data identifier;

generating a mapping array according to the data identification and the sorting attribute value set;

and substituting the data number, the data identifier and the mapping array as structure parameters into a preset mapping storage structure to obtain mapping data conforming to the mapping storage structure.

In the implementation process, the method can preferentially acquire the data number corresponding to the data identifier in the process of acquiring the mapping data, and then generate the mapping array according to the data identifier and the sorting attribute value set, wherein the mapping array comprises the sorting attribute value set except the first sorting attribute value and the data number; after the data number, the mapping array and the data identifier are obtained, the data number, the mapping array and the data identifier are embedded into a preset mapping storage structure, so that the mapping storage structure generates mapping data after the specific data are combined, and the mapping data also accord with the mapping storage structure. Therefore, by implementing the implementation mode, the number and the identification corresponding to the data and the mapping array corresponding to the identification can be obtained, so that the mapping relation among the data, the identification and the mapping array in one-to-one correspondence is realized, and the establishment of the mapping relation is favorable for improving the query convenience and the query accuracy of the database in use.

Further, the step of storing the mapping data according to a preset mapping storage scheme to obtain a data table for querying the data identifier and the sorting attribute value set includes:

calling a data table to generate an instruction according to a preset mapping storage scheme;

and storing the mapping data according to the data table generating instruction to obtain a data table for inquiring the data identification and the sorting attribute value set.

In the implementation process, in the process of acquiring the data table used for representing the data mapping relationship, the method may call a data table generation instruction according to a preset mapping storage scheme, where the data table generation instruction may be a data table generation instruction used for generating a hash table; after the data table generation instruction is acquired, the mapping data is nested into the data table generation instruction, so that the new data table generation instruction can directly store the mapping data into the data table, and the data table can be used for inquiring the data identification and the sorting attribute value set. Therefore, by implementing the implementation mode, the mapping data can be stored in the data table through the data table generating instruction, so that the data table can be beneficial to one-way query of the data after the database is established, and the problems of poor query effect when the data size is large and high concurrent processing difficulty in the data query process can be solved.

Further, the database establishing method is executed by a preset program execution script.

In the implementation process, the method is executed by using a preset program execution script, and the method can be executed as a whole, so that the method cannot be inserted by other commands in the execution process, the consistency of data in the database can be ensured, and the stability of data storage can be further ensured.

A second aspect of the embodiments of the present application provides a database creating apparatus, where the database creating apparatus includes:

the acquisition unit is used for acquiring a data identifier and a sequencing attribute value set of data to be stored;

the first generation unit is used for generating sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set;

and the first storage unit is used for sequencing and storing the sequencing data according to a preset sequencing and storing scheme to obtain a database with a specific data sequence.

In the implementation process, the database establishing device can acquire the data identifier and the sorting attribute value set of the data to be stored through the acquisition unit; the first generation unit can also generate sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set; and finally, sequencing and storing the sequencing data according to a preset sequencing and storing scheme through the first storage unit to obtain a database with a specific data sequence. Therefore, by implementing the implementation mode, the sequencing data which accord with the data storage structure can be obtained by preprocessing the data to be stored through each unit, so that the finally established database is constructed based on the sequencing data, the database can be orderly constructed through the corresponding sequencing of the data in the database, the problem of poor query effect when the data volume is large can be solved in the using process of the database, and the method can be applied to a high-concurrency data query scene.

Further, the database building device further includes:

the second generation unit is used for generating mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identification and the sorting attribute value set;

and the second storage unit is used for storing the mapping data according to a preset mapping storage scheme to obtain a data table used for inquiring the data identification and the sorting attribute value set.

In the implementation process, after the database is established, a mapping relation between the stored data ID and the sorted data can be further established to support the query of a data set (the data table) of the serial number of the single piece of data, so that after the database is established, a better query effect can be achieved in the query of the single piece of data, thereby being beneficial to improving the use and use effect of the database and enriching the use and use of the database.

Further, the first generation unit includes:

the first acquiring subunit is used for acquiring a database number corresponding to the data identifier;

the first obtaining subunit is further configured to obtain a top ordering attribute value included in the ordering attribute value set;

the first generation subunit is used for generating an ordering array according to the data identification and the ordering attribute value set;

and the first generation subunit is used for substituting the database number, the first ordering attribute value and the ordering array as structure parameters into a preset data storage structure to obtain ordering data conforming to the data storage structure.

In the implementation process, corresponding specific data can be correspondingly acquired according to various structural parameters included by the data storage structure, so that the data storage structure obtains effective sequencing data after the specific data are filled, the sequencing data can be acquired more accurately and effectively, the ordering of the data in the database can be further improved through the sequencing data of the data storage structure, the ordered and stable database can be conveniently established, and the improvement of the use convenience of subsequent query is facilitated.

Further, the first storage unit includes:

the first calling subunit is used for calling a database storage instruction according to a preset sequencing storage scheme;

and the first storage subunit is used for sequencing and storing the sequencing data according to the database storage instruction to obtain a database with a specific data sequence.

In the implementation process, the sequencing data can be stored into the database in order through the database storage instruction, so that the database has corresponding sequencing in the establishing process, the problem of poor query effect when the data volume is large is solved conveniently, and meanwhile, the method can be applied to a high-concurrency data query scene.

Further, the second generation unit includes:

the second acquiring subunit is used for acquiring the data number corresponding to the data identifier;

the second generation subunit is used for generating a mapping array according to the data identification and the sorting attribute value set;

and the second generation sub-unit is used for substituting the data number, the data identifier and the mapping array as structure parameters into a preset mapping storage structure to obtain mapping data conforming to the mapping storage structure.

In the implementation process, the number and the identification corresponding to the data and the mapping array corresponding to the identification can be obtained, so that the mapping relation among the data, the identification and the mapping array in one-to-one correspondence is realized, and the establishment of the mapping relation is favorable for improving the query convenience and the query accuracy of the database in use.

Further, the second storage unit includes:

the second calling subunit is used for calling a data table generation instruction according to a preset mapping storage scheme;

and the second storage subunit is used for storing the mapping data according to the data table generation instruction to obtain a data table used for inquiring the data identification and the sorting attribute value set.

In the implementation process, the mapping data can be stored in the data table through the data table generating instruction, so that the data table can be beneficial to one-way query of the data after the database is established, and the problems of poor query effect when the data volume is large and high concurrent processing difficulty in the data query process can be solved.

Further, the database creation means executes the script based on a preset program execution script.

A third aspect of the embodiments of the present application provides an electronic device, including a memory and a processor, where the memory is used to store a computer program, and the processor runs the computer program to make the electronic device execute the database establishment method described in any one of the first aspect of the embodiments of the present application.

A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, which stores computer program instructions, and when the computer program instructions are read and executed by a processor, the computer program instructions perform the database establishment method according to any one of the first aspect of the embodiments of the present application.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.

Fig. 1 is a schematic flowchart of a database establishment method according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart of another database establishment method according to an embodiment of the present disclosure;

fig. 3 is a schematic flowchart of another database establishment method according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of a database building apparatus according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of another database establishment apparatus according to an embodiment of the present application

Fig. 6 is a schematic flowchart of writing data to be sorted by using a Lua script according to an embodiment of the present application;

fig. 7 is a schematic flowchart of reading a data list according to an embodiment of the present application;

fig. 8 is a schematic flowchart of reading a single data sequence number according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.

Example 1

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a database establishing method according to an embodiment of the present application. The method is applied to the establishment process of the database, and particularly when the method is applied to the establishment of the database with large data volume, the method is used for fundamentally solving the problems of low performance and small number of concurrent queries when the traditional method utilizes sql statements to specify a plurality of sequencing conditions to perform data query in the database. The database establishing method comprises the following steps:

s101, acquiring a data identifier and an ordering attribute value set of data to be stored.

In this embodiment, the data to be stored may be one data or a plurality of data, and this embodiment is not limited in any way.

In this embodiment, the data to be stored may be understood as one characterization data of a plurality of data to be stored, and it may be understood that, in the plurality of data to be stored, the storage flow of each data to be stored is the same.

In this embodiment, the data to be stored may be described as one of a plurality of data, where each of the plurality of data may be understood as being in the process of processing the data to be stored.

In this embodiment, the data identifier is a data ID of the data to be stored, that is, an identity identifier of the data to be stored.

In the present embodiment, the data ID may be X1.

In this embodiment, the sorting attribute value set is a set of a plurality of sorting attribute values, where when the sorting attribute value is set as S1 or S2 … Sn, the data to be stored is sorted according to a plurality of attributes such as S1 or S2 … Sn, that is: s1, S1 is the same, then S2, Sn and so on.

S102, generating sorting data according with the data storage structure according to the preset data storage structure, the data identification and the sorting attribute value set.

In this embodiment, the data storage structure is preset, and the data storage structure is a SortedSets data structure conforming to Redis.

In this embodiment, the data identifier is the data ID described above.

In this embodiment, the sorting data is a data set conforming to the data structure of the Sorted Sets of Redis.

S103, sorting and storing the sorted data according to a preset sorting and storing scheme to obtain a database with a specific data sequence.

In this embodiment, the ordered storage scheme includes an ordered storage instruction, and an application occasion of the ordered storage instruction.

In this embodiment, in the process of sorting storage, because the sorting data has the effect of sorting, a specific data sequence is generated in the process of storage naturally, so that the generated database has the specific data sequence.

In this embodiment, the database establishing method is executed by executing a script through a preset program.

By implementing the embodiment, the method can be executed as a whole, so that the method cannot be inserted by other commands in the execution process, the consistency of the data in the database can be ensured, and the stability of data storage can be ensured.

In this embodiment, the execution subject of the method may be a computing device such as a computer and a server, and is not limited in this embodiment.

In this embodiment, an execution subject of the method may also be a smart device such as a smart phone and a tablet, which is not limited in this embodiment.

In this embodiment, in the conventional Redis-based data structure of Sorted Sets, a plurality of attributes to be Sorted are assembled into a large number according to high and low bits and stored in the score value, and when data is newly added, the Sorted Sets are stored according to the size order of the score. When inquiring, directly utilizing api provided by Redis. The limitation of this scheme is that the score values of Sorted Sets are held in 64-bit floating point numbers, which are only allowed in the range of- (2^53) to + (2^ 53). If there are many more ordering attributes, or if some attribute has a value of 64 bits long, then the assembled value will exceed the score value range. Score exceeding this range is represented by scientific counting, which can lose precision leading to misordering. Therefore, by implementing the implementation manner described in the embodiment, the above problems can be avoided, and the database use effect can be improved.

It can be seen that, by implementing the database establishing method described in fig. 1, a large number of data to be stored can be preferentially acquired, and a data ID and a sorting attribute value set corresponding to each data to be stored can be simultaneously acquired, where the sorting attribute value set includes a plurality of sorting attribute values, and a priority order of sorting exists among the plurality of sorting attribute values; after the data identification and the sorting attribute value set of the data to be stored are obtained, the data ID and the sorting attribute value set are preprocessed, so that the preprocessed structure conforms to a preset data storage structure, the data storage structure can adapt to a preset sorting storage scheme, sorting storage of the data is facilitated, and a database with a specific data sequence is obtained. Therefore, by implementing the implementation mode, the sequencing data which accord with the data storage structure can be obtained by preprocessing the data to be stored, so that the finally established database is constructed based on the sequencing data, the database can be orderly constructed through the corresponding sequencing of the data in the database, the problem of poor query effect when the data volume is large can be solved in the using process of the database, and the method can be applied to a high-concurrency data query scene.

Example 2

Referring to fig. 2, fig. 2 is a schematic flow chart of another database establishment method according to an embodiment of the present application. The flow diagram of the database building method depicted in fig. 2 is improved from the flow diagram of the database building method depicted in fig. 1. The database establishing method comprises the following steps:

s201, acquiring a data identifier and an ordering attribute value set of data to be stored.

In the present embodiment, the data ID may be X1.

S202, generating sorting data according with the data storage structure according to the preset data storage structure, the data identification and the sorting attribute value set.

In this embodiment, the data identifier is the data ID described above.

S203, sequencing and storing the sequencing data according to a preset sequencing and storing scheme to obtain a database with a specific data sequence.

And S204, generating mapping data conforming to the mapping storage structure according to the preset mapping storage structure, the data identification and the sequencing attribute value set.

In this embodiment, the mapping storage structure is preset, and the mapping storage structure is a Hashes (hash value) structure conforming to Redis.

In this embodiment, the data identifier is the data ID described above.

In this embodiment, the sorted data is a data set conforming to a Hashes data structure of Redis.

S205, storing the mapping data according to a preset mapping storage scheme to obtain a data table for inquiring the data identification and sorting the attribute value set.

In this embodiment, the data table may be a hash table.

In this embodiment, the mapping storage scheme includes a mapping storage instruction, and an application occasion of the mapping storage instruction.

In this embodiment, in the process of storing, one piece of data may be stored in the data table.

By implementing the implementation mode, the mapping relation between the user ID and the sorting attribute value set can be stored in a Hashes structure of Redis, so that the requirement of inquiring the sorting sequence number corresponding to the specified data ID is met.

In this embodiment, the program execution script may be a lua script, where the lua script is used to implement the saving logic, because the Redis executes the lua script as a whole, so that the database is not inserted by other commands in the database establishing process, thereby ensuring the consistency of data in the Redis.

In this embodiment, data is already stored according to a specified sequence after being written into the Redis, and when we query, we only need to call api of the Redis to read the sorted data in a specified range.

It can be seen that, by implementing the database establishment method described in fig. 2, the ordering data conforming to the data storage structure is obtained by preprocessing the data to be stored, so that the finally established database is established based on the ordering data, and the database can be orderly established through the corresponding ordering of the data in the database, thereby solving the problem of poor query effect when the data volume is large in the process of using the database, and being also applicable to a high-concurrency data query scene

Example 3

Referring to fig. 3, fig. 3 is a schematic flowchart of another database establishment method according to an embodiment of the present application. The flow diagram of the database building method depicted in fig. 3 is improved from the flow diagram of the database building method depicted in fig. 2. The database establishing method comprises the following steps:

s301, acquiring a data identifier and an ordering attribute value set of data to be stored.

In the present embodiment, the data ID may be X1.

And S302, acquiring a database number corresponding to the data identifier.

In this embodiment, the database number refers to the ranking of the data, wherein the ranking of the data can be represented by R1.

In the present embodiment, the database number may be equal to the database query start value N1 plus the rank R1 of the data obtained by traversing index I1 during the database retrieval process.

In this embodiment, the database number corresponds to R1.

S303, acquiring a first-order attribute value included in the ordering attribute value set.

In this embodiment, the combination of the sorted attribute values includes S1 and S2 … Sn, where the top sorted attribute value is S1.

In this embodiment, the top-ranked attribute value corresponds to S1.

S304, generating a sorting array according to the data identification and the sorting attribute value set.

In this example, the above-mentioned S2 … Sn and X1 are expressed as ": "the partitions are sequentially spliced into a string V1.

In this embodiment, the sorting array corresponds to V1.

S305, substituting the database number, the first-order sorting attribute value and the sorting array as structure parameters into a preset data storage structure to obtain sorting data conforming to the data storage structure.

In this embodiment, the preset data storage structure is a Remote Dictionary service (Remote Dictionary service) Sorted Sets data structure, and the Sorted Sets data structure includes three structure parameters of a key score register.

In this embodiment, the data structure of the Sorted Sets of Redis is Sorted according to score value first, and then Sorted according to the number value under the condition that the scores are the same. The score value is held in 64-bit floating point numbers, only allowed in the range of- (2^53) to + (2^ 53). Wherein the number value has no length limitation.

In this embodiment, the above-mentioned database number R1 is substituted into the key position, the above-mentioned top ranking attribute value S1 is substituted into the score position, and the ranking array V1 is substituted into the member position, thereby obtaining ranking data conforming to the data storage structure.

By implementing the implementation mode, the requirements of sequencing according to S1 and S2 … Sn can be realized. Wherein, the X1 is added in the number to fetch the data ID by the number value at the time of inquiry.

And S306, calling a database storage instruction according to a preset sequencing storage scheme.

In this embodiment, the database storage instruction may be a Redis Zadd command.

In this embodiment, the Redis Zadd command is used to add one or more member elements and their fractional values to the ordered set. If a member is already a member of the ordered set, the score value for that member is updated and the member is guaranteed to be in the correct position by reinserting the member element. The fractional value may be an integer value or a double precision floating point number. If the ordered set key does not exist, an empty ordered set is created and the Zadd operation is performed. When a key exists but is not of an ordered set type, an error is returned.

In this embodiment, the basic syntax of the Redis Zadd command is as follows:

redis 127.0.0.1:6379>ZADD KEY_NAME SCORE1 VALUE1..SCOREN VALUEN。

s307, sorting and storing the sorted data according to the database storage instruction to obtain a database with a specific data sequence.

In this embodiment, this step may be understood as a process to Redis that calls a Redis Zadd command to store sorted data.

And S308, acquiring a data number corresponding to the data identifier.

In this embodiment, the data number corresponds to one number corresponding to each data, and the number is generally identified by H1.

S309, generating a mapping array according to the data identification and the sorting attribute value set.

In this embodiment, the contents of the mapping array are the same as those of the sorting array, and are all denoted by V1.

S310, substituting the data number, the data identification and the mapping array as structure parameters into a preset mapping storage structure to obtain mapping data conforming to the mapping storage structure.

In this embodiment, the mapping storage structure is a Hashes structure of Redis, and the Hashes structure of Redis includes three structure parameters of a keyfield value.

In this embodiment, the data number H1 is substituted into the key position, the mapping array V1 is substituted into the field position, and the data identifier X1 is substituted into the field position, so as to obtain mapping data corresponding to the mapping storage structure.

S311, calling a data table generating instruction according to a preset mapping storage scheme.

In this embodiment, the data table generating instruction may be a Redis Hset command.

In this embodiment, the Redis Hset command is used to assign values to fields in the hash table. If the hash table does not exist, a new hash table is created and HSET operations are performed. If the field is already present in the hash table, the old value will be overwritten. S312, storing the mapping data according to the data table generating instruction to obtain a data table for inquiring the data identification and sorting the attribute value set.

In this embodiment, the basic syntax of the Redis Hset command is as follows:

redis 127.0.0.1:6379>HSET KEY_NAME FIELD VALUE。

In this embodiment, the above process may be understood as a process of writing data to be sorted by Lua.

For example, please refer to fig. 6, fig. 6 is a schematic diagram illustrating a flow of writing data to be sorted by Lua, wherein the flow in fig. 6 is the same as that described in the explanation of the present embodiment, and thus, further description is omitted.

Referring to fig. 7, fig. 7 is a flow chart of reading a data list, wherein the principle for reading an ordered data list is explained as follows: the process obtains a Sorted data list L1 from the Sorted Sets data structure of Redis according to a specified starting sequence number N1 and an ending sequence number N2 through a zrev rangebyscore instruction; then, L1 is traversed sequentially, truncating the last ": "the following string, saved as string X1, X1 is the ID of the data, N1 plus the traversed index I1 is the rank R1 of the data. Thus, we have queried all data IDs in the range of N1 to N2 and the sorted order number of each data ID.

Referring to fig. 8, fig. 8 is a schematic flowchart of a process for reading a single data sequence number, wherein the principle for reading a single data sequence number is explained as follows: calling an HGET command and a parameter X1 (data ID) to obtain D1 from a Hashes data structure of REDIS, wherein D1 is the same as the number value of X1 stored in a Sorted Sets structure; then, a command ZREVRANK command and a parameter D1 are called to obtain the sorting sequence number M1 of the data X1 from the Sorted Sets structure of the REDIS; this obtains the ordered sequence number of the single piece of data.

It can be seen that, by implementing the database establishment method described in fig. 3, after the database is established, the mapping relationship between the stored data ID and the sorted data can be further established to support the query of the data set (the data table) of the serial number of the single data, so that after the database is established, a better query effect can be achieved in the query of the single data, thereby facilitating the improvement of the use and use effect of the database and enriching the use and use of the database; the corresponding specific data can be correspondingly acquired according to various structural parameters included by the data storage structure, so that the data storage structure can acquire effective sequencing data after being filled with the specific data, the sequencing data can be acquired more accurately and effectively, the ordering of the data in the database can be further improved through the sequencing data of the data storage structure, the ordered and stable database establishment is further facilitated, and the use convenience of subsequent query is also improved; the sequencing data can be orderly stored in the database through the database storage instruction, so that the database has corresponding sequencing in the establishing process, the problem of poor query effect when the data volume is large is solved, and meanwhile, the method can be applied to a high-concurrency data query scene; the serial number and the identification corresponding to the data and the mapping array corresponding to the identification can be obtained, so that the mapping relation among the data, the identification and the mapping array in one-to-one correspondence is realized, and the establishment of the mapping relation is favorable for improving the query convenience and the query accuracy of the database in use; mapping data can be stored in the data table through a data table generating instruction, so that the data table can be beneficial to unidirectional query of the data after the database is established, and the problems of poor query effect when the data volume is large and high concurrent processing difficulty in the data query process can be solved; finally, the method is executed by using a preset program execution script, and can be executed as a whole, so that the method cannot be inserted by other commands in the execution process, the consistency of data in the database can be ensured, and the stability of data storage can be further ensured.

Example 4

Referring to fig. 4, fig. 4 is a schematic structural diagram of a database building apparatus according to an embodiment of the present application. Wherein, this database establishment apparatus includes:

an obtaining unit 410, configured to obtain a data identifier and an ordering attribute value set of data to be stored;

a first generating unit 420, configured to generate sorting data conforming to the data storage structure according to a preset data storage structure, the data identifier, and the sorting attribute value set;

the first storage unit 430 is configured to perform sorting storage on the sorted data according to a preset sorting storage scheme, so as to obtain a database with a specific data sequence.

In this embodiment, for the explanation of the database establishing apparatus, reference may be made to the description in embodiment 1, embodiment 2, or embodiment 3, and details are not repeated in this embodiment.

It can be seen that, with the database establishing apparatus described in fig. 4, the data identifier and the sorting attribute value set of the data to be stored can be obtained by the obtaining unit; the first generation unit can also generate sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set; and finally, sequencing and storing the sequencing data according to a preset sequencing and storing scheme through the first storage unit to obtain a database with a specific data sequence. Therefore, by implementing the implementation mode, the sequencing data which accord with the data storage structure can be obtained by preprocessing the data to be stored through each unit, so that the finally established database is constructed based on the sequencing data, the database can be orderly constructed through the corresponding sequencing of the data in the database, the problem of poor query effect when the data volume is large can be solved in the using process of the database, and the method can be applied to a high-concurrency data query scene.

Example 5

Referring to fig. 5, fig. 5 is a schematic structural diagram of another database establishment apparatus according to an embodiment of the present application. The structure diagram of the database building apparatus depicted in fig. 5 is modified according to the structure diagram of the database building apparatus depicted in fig. 4. Wherein, the database establishing device further comprises:

the second generating unit 440 is configured to generate mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identifier, and the sorting attribute value set;

the second storage unit 450 is configured to store the mapping data according to a preset mapping storage scheme, so as to obtain a data table for querying the data identifier and sorting the attribute value set.

As an alternative embodiment, the first generating unit 420 includes:

a first obtaining subunit 421, configured to obtain a database number corresponding to the data identifier;

the first obtaining subunit 421, further configured to obtain a top-ordered attribute value included in the ordered attribute value set;

a first generating subunit 422, configured to generate an ordering array according to the data identifier and the ordering attribute value set;

the first insertion subunit 423 is configured to insert the database number, the top ordering attribute value, and the ordering array as structure parameters into a preset data storage structure to obtain ordering data that conforms to the data storage structure.

As an alternative embodiment, the first storage unit 430 includes:

the first calling subunit 431 is configured to call a database storage instruction according to a preset sorting storage scheme;

the first storage subunit 432 is configured to perform sorting storage on the sorted data according to the database storage instruction, so as to obtain a database with a specific data order.

As an optional implementation, the second generating unit 440 includes:

the second obtaining subunit 441 is configured to obtain a data number corresponding to the data identifier;

a second generating subunit 442, configured to generate a mapping array according to the data identifier and the sorting attribute value set;

and a second generation sub-unit 443, configured to substitute the data number, the data identifier, and the mapping array as structure parameters into a preset mapping storage structure, so as to obtain mapping data that conforms to the mapping storage structure.

As an alternative embodiment, the second storage unit 450 includes:

the second calling subunit 451 is configured to call a data table generation instruction according to a preset mapping storage scheme;

and the second storage subunit 452 is configured to store the mapping data according to the data table generation instruction, so as to obtain a data table used for querying the data identifier and sorting the attribute value set.

As an alternative embodiment, the database creation means executes the script based on a preset program execution script.

It can be seen that, with the database establishing apparatus described in fig. 5, the data identifier and the sorting attribute value set of the data to be stored can be obtained by the obtaining unit; the first generation unit can also generate sorting data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorting attribute value set; and finally, sequencing and storing the sequencing data according to a preset sequencing and storing scheme through the first storage unit to obtain a database with a specific data sequence. Therefore, by implementing the implementation mode, the sequencing data which accord with the data storage structure can be obtained by preprocessing the data to be stored through each unit, so that the finally established database is constructed based on the sequencing data, the database can be orderly constructed through the corresponding sequencing of the data in the database, the problem of poor query effect when the data volume is large can be solved in the using process of the database, and the method can be applied to a high-concurrency data query scene.

An embodiment of the present application provides an electronic device, which includes a memory and a processor, where the memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to execute any one of the database establishment methods in embodiment 1, embodiment 2, and embodiment 3 of the present application.

The embodiment of the present application provides a computer-readable storage medium, which stores computer program instructions, and when the computer program instructions are read and executed by a processor, the method for establishing a database according to any one of embodiments 1, 2, and 3 of the present application is executed.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Claims

1. A method of database building, the method comprising:

2. The database building method according to claim 1, wherein the method further comprises:

generating mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identification and the sorting attribute value set;

and storing the mapping data according to a preset mapping storage scheme to obtain a data table for inquiring the data identification and the sorting attribute value set.

3. The database building method according to claim 1, wherein the step of generating the sorted data conforming to the data storage structure according to a preset data storage structure, the data identification and the sorted attribute value set comprises:

acquiring a database number corresponding to the data identifier;

4. The database building method according to claim 1, wherein the step of performing sorted storage on the sorted data according to a preset sorted storage scheme to obtain the database with a specific data sequence comprises:

5. The database building method according to claim 2, wherein the step of generating mapping data conforming to the mapping storage structure according to a preset mapping storage structure, the data identifier and the sorting attribute value set comprises:

acquiring a data number corresponding to the data identifier;

6. The database building method according to claim 2, wherein the step of storing the mapping data according to a preset mapping storage scheme to obtain a data table for querying the data identifier and the sorting attribute value set comprises:

7. The database building method according to claim 1, wherein the database building method is executed by a preset program execution script.

8. A database building apparatus, characterized in that the database building apparatus comprises:

9. The database building apparatus according to claim 8, wherein the database building apparatus further comprises:

10. The database building apparatus according to claim 8, wherein the database building apparatus executes based on a preset program execution script.

11. An electronic device, characterized in that the electronic device comprises a memory for storing a computer program and a processor for executing the computer program to cause the electronic device to perform the database building method of any one of claims 1 to 7.

12. A readable storage medium having stored thereon computer program instructions which, when read and executed by a processor, perform the database building method of any one of claims 1 to 7.