CN115185979A

CN115185979A - Data access routing method, apparatus device, storage medium and program product

Info

Publication number: CN115185979A
Application number: CN202210888049.XA
Authority: CN
Inventors: 程春生; 王辉; 巫春梅; 谢波
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2022-07-26
Filing date: 2022-07-26
Publication date: 2022-10-14

Abstract

The disclosure provides a data access routing method which can be applied to the technical field of cloud computing. The method is applied to a multi-park database, the multi-park database is provided with a plurality of database connection pools, and the method comprises the following steps: allocating a logical connection object to an application in response to a database access request of the application; determining a target database connection pool according to the database structured query statement and a preset routing strategy rule; establishing an association relation between the target database connection pool and the logic connection object; submitting the database structured query statement to a target database corresponding to the target database connection pool according to the incidence relation; and obtaining an execution result and returning the execution result to the application. The present disclosure also provides a data access routing apparatus, a device, a storage medium, and a program product.

Description

Data access routing method, apparatus device, storage medium and program product

Technical Field

The present disclosure relates to the field of cloud computing technologies, and in particular, to the field of database routing technologies, and in particular, to a data access routing method, apparatus, device, storage medium, and program product.

Background

The current mainstream modes for accessing the database by the application are all modes through data sources, and a database connection pool provided by most of the data sources can assist in managing and accessing database connection, so that the connection utilization rate and the access efficiency are improved. Under the unitized background, the deployment of the database in the sub-park and the storage of the data in the sub-park are popular, and the current mainstream data sources only support the configuration of a fixed database address, so that the requirement of accessing the multi-park database is difficult to meet. Under the condition of using the current data source, the application program needs to additionally perform a plurality of logic controls to meet the requirement of multi-park access, and both the development cost and the transformation risk are high.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

In view of the foregoing, the present disclosure provides data access routing methods, apparatuses, devices, media and program products that improve data source multiplexing.

According to a first aspect of the present disclosure, there is provided a data access routing method, applied to a multi-campus database, where the multi-campus database configures multiple database connection pools, the data access routing method including:

allocating a logical connection object to an application in response to a database access request of the application;

determining a target database connection pool according to the database structured query statement and a preset routing strategy rule;

establishing an association relation between the target database connection pool and the logic connection object;

submitting the database structured query statement to a target database corresponding to the target database connection pool according to the incidence relation; and

and obtaining an execution result and returning the execution result to the application.

According to an embodiment of the present disclosure, the preset routing policy rule includes a table name matching rule and a table field matching rule, and the determining the target database connection pool according to the database structured query statement and the preset routing policy rule includes:

acquiring a database structured query statement submitted by an application;

identifying a table name and a table field in the database structured query statement; and

and determining a target database connection pool according to the table name, the table field, the table name matching rule and the table field matching rule.

According to an embodiment of the present disclosure, the determining a target database connection pool according to the table name, the table field, the table name matching rule, and the table field matching rule includes:

when the table name is determined to be matched with the table name matching rule and the table field is determined to be matched with the table field matching rule, determining a database connection pool matched with the table field as a target database connection pool; and

and when the table name is determined to be matched with the table name matching rule and the table field is not matched with the table field matching rule, determining the database connection pool matched with the table name as a target database connection pool.

According to an embodiment of the present disclosure, the table field matching rule includes a numeric field value size matching, a string field value matching, and a substring matching, and the table field matching rule includes:

and when at least one matching rule of the numerical value field value size matching, the character string field value matching and the sub-character string matching is successfully matched, determining that the table field matches the table field matching rule.

According to an embodiment of the present disclosure, establishing an association relationship between the target database connection pool and the logical connection object includes:

determining a current database connection pool associated with the logical connection object;

when the current database connection pool is determined to be inconsistent with the target database connection pool, updating the current association relation of the logical connection object according to the target database connection pool and the logical connection object; and

and when the current database connection pool is determined to be consistent with the target database connection pool, keeping the current association relation of the logic connection object.

According to an embodiment of the present disclosure, the updating the current association relationship of the logical connection object according to the target database connection pool and the logical connection object includes:

canceling the current association relation of the logical connection object;

and reestablishing the association relationship between the target database connection pool and the logic connection object.

According to an embodiment of the present disclosure, before allocating a logical connection object to the application, the method further includes:

obtaining an available number of logical connection objects, the available number of logical connection objects being determined according to the plurality of database connection pools of the multi-campus database;

when the available number of the logical connection objects is larger than or equal to a preset threshold value, allocating the logical connection objects to the application; and

and when the available number of the logic connection objects is smaller than a preset threshold value, returning a connection waiting instruction to the application.

According to the embodiment of the present disclosure, after the application finishes accessing the target database, the method further includes:

canceling the incidence relation of the logical connection object; and

and recovering the logic connection object.

A second aspect of the present disclosure provides a data access routing apparatus, which is applied to a multi-campus database, where the multi-campus database configures multiple database connection pools, and the apparatus includes:

the system comprises a logic connection object distribution module, a data processing module and a data processing module, wherein the logic connection object distribution module is used for responding to a database access request of an application and distributing a logic connection object to the application;

the determining module is used for determining a target database connection pool according to the database structured query statement and the preset routing strategy rule;

the association module is used for establishing an association relationship between the target database connection pool and the logical connection object;

the database connection module is used for submitting the database structured query statement to a target database corresponding to the target database connection pool according to the incidence relation; and

and the return module is used for acquiring the execution result and returning the execution result to the application.

According to an embodiment of the present disclosure, further comprising:

an obtaining module, configured to obtain an available number of logical connection objects, where the available number of logical connection objects is determined according to the multiple database connection pools of the multi-campus database;

and the logical connection object recovery module is used for recovering the logical connection object.

According to an embodiment of the disclosure, the determining module includes:

the first determining submodule is used for acquiring a database structured query statement submitted by an application;

the identification submodule is used for identifying the table name and the table field in the database structured query statement; and

and the second determining submodule is used for determining a target database connection pool according to the table name, the table field, the table name matching rule and the table field matching rule.

According to an embodiment of the present disclosure, the second determination submodule includes:

the first determining unit is used for determining a database connection pool matched with the table field as a target database connection pool when the table name is determined to be matched with the table name matching rule and the table field is determined to be matched with the table field matching rule; and

and the second determining unit is used for determining the database connection pool matched with the table name as a target database connection pool when the table name is determined to be matched with the table name matching rule and the table field is not matched with the table field matching rule.

According to an embodiment of the present disclosure, the first determination unit includes:

a determining subunit, configured to determine that the table field matches the table field matching rule when it is determined that at least one matching rule of the numeric field value size matching, the string field value matching, and the sub-string matching is successfully matched.

According to an embodiment of the disclosure, the association module includes:

a third determining submodule, configured to determine a current database connection pool associated with the logical connection object;

a fourth determining submodule, configured to update a current association relationship of the logical connection object according to the target database connection pool and the logical connection object when it is determined that the current database connection pool is inconsistent with the target database connection pool; and

and a fifth determining submodule, configured to keep the current association relationship of the logical connection object when it is determined that the current database connection pool is consistent with the target database connection pool.

According to an embodiment of the present disclosure, the fourth determination sub-module includes:

the incidence relation canceling unit is used for canceling the current incidence relation of the logical connection object;

and the association unit is used for reestablishing the association relationship between the target database connection pool and the logical connection object.

According to an embodiment of the present disclosure, further comprising:

the first judgment module is used for distributing the logic connection objects to the application when the available number of the logic connection objects is larger than or equal to a preset threshold value; and

and the second judging module is used for returning a connection waiting instruction to the application when the available number of the logic connection objects is smaller than a preset threshold value.

According to an embodiment of the present disclosure, further comprising:

the incidence relation canceling module is used for canceling the incidence relation of the logical connection object; and

and the recovery module is used for recovering the logic connection object.

A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the data access routing method described above.

A fourth aspect of the present disclosure also provides a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the above-described data access routing method.

A fifth aspect of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the data access routing method described above.

By the data access routing method provided by the embodiment of the disclosure, a logical connection object is allocated to an application in response to a database access request of the application; determining a target database connection pool according to the database structured query statement and a preset routing strategy rule; establishing an association relation between the target database connection pool and the logic connection object; submitting the database structured query statement to a target database corresponding to the target database connection pool according to the incidence relation; and obtaining an execution result and returning the execution result to the application. The distribution and the recovery of the logical connection objects are controlled to further realize the control of the connection number of the database, and the overflow of a database connection pool in a high concurrency scene is prevented.

Drawings

The foregoing and other objects, features and advantages of the disclosure will be apparent from the following description of embodiments of the disclosure, which proceeds with reference to the accompanying drawings, in which:

FIG. 1 schematically illustrates an application scenario diagram of a data access routing method, apparatus, device, medium, and program product according to embodiments of the disclosure;

FIG. 2a schematically illustrates an architecture diagram of a data access routing device provided in accordance with an embodiment of the present disclosure;

FIG. 2b schematically illustrates a flow diagram of an application program interacting with a data access routing device provided according to an embodiment of the present disclosure;

fig. 3 schematically illustrates a flow chart of a data access routing method provided according to an embodiment of the present disclosure;

FIG. 4a is a flow chart of a method for determining a connection pool of a target database according to an embodiment of the disclosure;

FIG. 4b schematically illustrates a second flowchart of a method for determining a connection pool of a target database according to an embodiment of the present disclosure;

FIG. 5a is a schematic diagram illustrating one of the flow charts provided for associating a target database connection pool with a logical connection object according to an embodiment of the present disclosure;

FIG. 5b schematically illustrates a second flowchart of associating a target database connection pool with a logical connection object according to an embodiment of the present disclosure;

FIG. 6a is a flow chart schematically illustrating a logical connection object assignment method provided in accordance with an embodiment of the present disclosure;

FIG. 6b is a flow chart that schematically illustrates a method for logical connection object reclamation, in accordance with an embodiment of the present disclosure;

FIG. 7 schematically shows a block diagram of a data access routing device according to an embodiment of the present disclosure; and

fig. 8 schematically illustrates a block diagram of an electronic device adapted to implement a data access routing method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B, and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, and C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.).

The terms appearing in the embodiments of the present disclosure are explained first:

the database is connected with the pool: the basic idea of the connection pool is to store database connections as objects in a memory during system initialization, and when a user needs to access the database, the user does not establish a new connection but takes out an established free connection object from the connection pool. After use, the user does not close the connection, but instead puts the connection back into the connection pool for the next access request. And the connection establishment and disconnection are managed by the connection pool. Meanwhile, the initial connection number, the upper and lower limit number of the connection, the maximum use number of each connection, the maximum idle time and the like in the connection pool can be controlled by setting parameters of the connection pool. The number of database connections, usage, etc. may also be monitored by its own management mechanism

A data source: a data source refers to a database or a database server used by a database application, and a Data Source Name (DSN) is a data structure containing information about a specific database, which is necessary for an open database connection driver to be able to connect to the database. The DSN is stored in a registry or as a separate text file, and the information contained in the DSN is the name, directory and database driver, as well as the user ID and password (depending on the type of DSN). The developer creates a separate DSN for each database. To connect to a certain database, a developer needs to specify the DSN in the program. In contrast, a connection without a DSN requires all the necessary information to be specified in the program.

At present, the mainstream data sources only support configuration of one database address, along with the development of a distributed architecture, database partition deployment and data partition storage tend to be great, when a multi-partition database is deployed, under the condition that the current data source is used, the requirement for accessing the multi-partition database can be met only by additionally adding a lot of logic control to an application program, and the development cost and the modification risk are high.

Based on the above technical problem, an embodiment of the present disclosure provides a data access routing method, which is applied to a multi-campus database, where the multi-campus database is configured with a plurality of database connection pools, and the data access routing method includes: allocating a logical connection object to an application in response to a database access request of the application; determining a target database connection pool according to the database structured query statement and a preset routing strategy rule; establishing an association relation between the target database connection pool and the logic connection object; submitting the database structured query statement to a target database corresponding to the target database connection pool according to the incidence relation; and obtaining an execution result and returning the execution result to the application.

Fig. 1 schematically illustrates an application scenario diagram of a data access routing method, apparatus, device, medium, and program product according to embodiments of the disclosure. Fig. 2a schematically shows an architecture diagram of a data access routing device provided according to an embodiment of the present disclosure, and fig. 2b schematically shows a flowchart of an application program interacting with the data access routing device provided according to an embodiment of the present disclosure.

As shown in fig. 1, the application scenario 100 according to this embodiment may include a multi-campus database access scenario. Network 104 is the medium used to provide communication links between

terminal devices

101, 102, 103 and server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as shopping-like applications, web browser applications, search-like applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only).

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 105 may be a multi-campus database routing server, and for a database access request initiated by a user through an application server, for example, in response to a database access request sent by a user using a

terminal device

101, 102, 103, the multi-campus database routing server determines a target database connection pool according to a received database structured query statement and according to a preset routing policy rule; and establishing connection between the application and the database, submitting a database structured query statement, returning an execution result and sending the execution result to the application.

It should be noted that the data access routing method provided by the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the data access routing apparatus provided by the embodiments of the present disclosure may be generally disposed in the server 105. The data access routing method provided by the embodiments of the present disclosure may also be performed by a server or server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Correspondingly, the data access routing device provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

It should be noted that the data access routing method and apparatus determined in the embodiments of the present disclosure may be used in the field of cloud computing technology, may also be used in the field of financial technology, and may also be used in any field other than the financial field.

As shown in fig. 2a, the data access routing method provided by the embodiment of the present disclosure is performed by a multi-campus database routing device, which specifically includes a data source registration unit 001, a connection management unit 002, a policy management unit 003, and a multi-data source management unit 004.

The data source registration unit 001 registers the JNDI of the data source in the form of a virtual data source, the application can be referred to the data source in the JNDI mode, and the data source provides a standard JDBC interface for the application to call and realize the functions of data source connection acquisition, SQL statement submission, transaction management, and the like. The connection management unit 002 mainly manages the logical connection objects of the virtual data sources, and is responsible for dynamically binding the logical connection objects to the corresponding data source connection objects. The application acquires the object of the data source through JDNI, and when the application calls the getConnection method, the connection management unit returns a logical connection object to the application for use. The policy management unit 003 is responsible for reading configured routing policies at component initialization, and providing appropriate data source objects for the connection management unit according to the routing policies, where the routing policies include: default data sources, table routing rules, value routing rules for fields, etc. The policy management unit supports hot loading and updating of the policies, and can complete updating in time to meet the requirement of multi-campus switching when the routing policies change. The multiple data source management unit 004 is responsible for managing configured multiple data sources, the data sources are referred in a JNDI manner, a data source object is generated for each data source, different types of data sources are supported, such as a middleware data source, a third-party source opening data source component and the like, each data source is configured in the JNDI manner, and the component acquires the object of each data source through the JNDI of each data source and associates the object of each data source with the corresponding policy in the policy management unit.

As shown in fig. 2b, the application program obtains a data source object, that is, a database connection pool, through a JNDI name registered by the data source registration unit 001, and initiates a database access request to the multi-campus database routing apparatus, and when the multi-campus database routing apparatus receives the database access request, the multi-campus database routing apparatus executes operation steps S01 to S05, where S01 denotes that a logical connection object is allocated to the application program, and S02 denotes that a target database connection pool is matched according to a preset route matching rule after receiving an SQL statement submitted by the application program; s03, after determining a target database connection pool, associating the database connection pool with the distributed logic connection object; and S04, submitting SQL statements to a database corresponding to the target database connection pool, sending the returned data to the application program, finishing the access of the application program to the database at the moment, returning the connection of the database connection pool by the application program after finishing the access to the database, and S05 showing that the database routing device finishes the recovery of the data source object and the logical connection object.

The data access routing method according to the embodiment of the present disclosure will be described in detail with fig. 3 to 6b based on the scenario described in fig. 1 and the architecture shown in fig. 2 a.

Fig. 3 schematically shows a flowchart of a data access routing method provided according to an embodiment of the present disclosure. As shown in fig. 3, the data access routing method of this embodiment includes operations S210 to S250, which may be performed by a server or other computing device. The data access routing method of the embodiment is applied to a multi-campus database, and the multi-campus database is provided with a plurality of database connection pools.

In operation S210, a logical connection object is allocated to an application in response to a database access request of the application.

In one example, the data access routing apparatus registers JNDI of the database connection pool (data source) in the form of a virtual data source, so that an application can refer to the database connection pool to be used by means of JNDI to access the target database. In the embodiment of the present disclosure, the data access routing apparatus may refer to data sources by a JNDI manner, generate a data source object for each data source, support different types of data sources, such as a middleware data source, a third-party open source data source component, and the like, each data source is configured by a JNDI manner, an application program obtains the data source object by a JNDI name registered by the data source registration unit, the application program invokes a get Connection method to initiate a database access request, when receiving the database access request of an application, since it is unclear which database the application program is to access at this time, the data access routing apparatus allocates a logical Connection object to the application first, the application is not sensitive to this operation, and for the application, it is requesting to connect a target database at this time.

In operation S220, a target database connection pool is determined according to the database structured query statement and the preset routing policy rule.

In an example, a database structured query statement, that is, an SQL statement, submitted by an application program is obtained, and a corresponding database connection pool is matched according to the SQL statement and a preset routing policy rule to serve as a target database connection pool, a process of operation S220 is actually a process of determining a target database to be accessed by the application program, and a specific matching process may refer to operations S221 to S223 shown in fig. 4a and 4b, which is not described herein again.

In operation S230, an association relationship is established between the target database connection pool and the logical connection object.

In an example, after determining the target database connection pool, an association relationship is established between the target database connection pool and the logical connection object, and an application program can establish a connection between the associated target database connection pool and the target database to perform an access operation on the target database, because the access operation on the database is usually performed many times, in order to improve multiplexing of the database connection pool and improve availability of a data access route, some logical judgments are required to be performed when the association relationship is established between the target database connection pool and the logical connection object, and a specific logical judgment process may refer to fig. 5a and 5b, which is not described herein again.

In operation S240, the database structured query statement is submitted to the target database corresponding to the target database connection pool according to the association relationship.

In operation S250, the execution result is acquired and returned to the application.

In one example, according to the association relationship determined in operation S230, a target database connection pool associated with the logical connection object is called to submit a database structured query statement SQL method, so that the SQL statement is submitted to the database with the specified route, an execution result is obtained and returned to the application, and the execution result is a processing result returned after accessing the database according to the SQL statement.

Fig. 4a schematically shows one of the flowcharts of the method for determining the target database connection pool provided in the embodiment of the present disclosure, and fig. 4b schematically shows the second flowchart of the method for determining the target database connection pool provided in the embodiment of the present disclosure. As shown in fig. 4a, operation S220 includes operations S221 to S223.

In operation S221, a database structured query statement submitted by an application is obtained.

In operation S222, a table name and a table field in the database structured query statement are identified.

In operation S223, a target database connection pool is determined according to the table name, the table field, the table name matching rule, and the table field matching rule.

According to the embodiment of the disclosure, the preset routing policy rule includes a table name matching rule and a table field matching rule.

According to an embodiment of the present disclosure, the table field matching rules include numeric field value size matching, string field value matching, and substring matching.

As shown in fig. 4b, operation S223 includes operation S2231 and operation S2232.

In operation S2231, when it is determined that the table name matches the table name matching rule and the table field matches the table field matching rule, determining that the database connection pool matching the table field is a target database connection pool.

According to an embodiment of the present disclosure, when it is determined that at least one matching rule of the numeric field value size matching, the string field value matching, and the sub-string matching is successfully matched, it is determined that the table field matches the table field matching rule.

In operation S2232, when it is determined that the table name matches the table name matching rule and there is no match between the table field and the table field matching rule, determining the database connection pool matching the table name as a target database connection pool.

In one example, the preset routing policy rule is preset according to actual service needs, and specifically includes a table name matching rule and a table field matching rule, where the table field matching rule further includes numeric field value size matching, character string field value matching, and sub-character string matching. Firstly, an SQL statement submitted by an application is obtained, a table name and a table field in the SQL statement are identified, and a table name matching rule and a table field matching rule are matched according to the identified table name and table field.

Specifically, the table name in the SQL request is identified and matched first, whether the table name is matched with the configured table name matching rule is searched, if not, a default database connection pool is returned to the connection management unit, if so, the matching condition of the sub-rule is continuously checked, that is, whether the table field matching rule is configured in the field of the table is further checked, if not, the database connection pool associated with the table routing rule is returned to the connection management unit, and if so, the matching condition of the field value rule is continuously checked. It is first determined which field of the table is matched and the matching rules, which may be the size range matching of numeric field values, the value matching and substring matching of string field values, etc. And if the matching is not successful, directly returning the database connection pool associated with the table routing rule to the connection management unit, and if the matching is successful, returning the database connection pool associated with the field value rule to the connection management unit.

Fig. 5a schematically shows one of the flowcharts for associating the target database connection pool with the logical connection object according to the embodiment of the present disclosure, and fig. 5b schematically shows the second flowchart for associating the target database connection pool with the logical connection object according to the embodiment of the present disclosure. As shown in fig. 5a, the operation S230 includes operations S231 to S233.

In operation S231, a current database connection pool associated with the logical connection object is determined.

In operation S232, when it is determined that the current database connection pool is inconsistent with the target database connection pool, updating the current association relationship of the logical connection object according to the target database connection pool and the logical connection object.

As shown in fig. 5b, operation S232 includes operation S2321 and operation S2322.

In operation S2321, the current association relationship of the logical connection object is cancelled.

In operation S2322, the association relationship between the target database connection pool and the logical connection object is reestablished.

In operation S233, when it is determined that the current database connection pool is consistent with the target database connection pool, maintaining the current association relationship of the logical connection object.

In one example, since the access operation of the application to the database is usually multiple accesses, in order to improve the multiplexing of the database connection pool and improve the availability of the data access route, some logic judgment is also performed when the association relationship is established between the target database connection pool and the logical connection object. Specifically, a current database connection pool associated with the logical connection object is determined, whether the current database connection pool and a target database connection pool are the same database connection pool is judged, and when the current database connection pool is determined to be consistent with the target database connection pool, the database accessed by the SQL statement submitted by the application last time and the database accessed this time are represented as the same database, so that the association relationship between the logical connection object and the current database connection pool is not required to be changed, and the method can be directly used. When the current database connection pool is determined to be inconsistent with the target database connection pool, the database representing the SQL statement access submitted by the application last time and the database accessed by the application this time are not the same database, and if the incidence relation is not updated, the SQL statement access is equivalent to the SQL statement submitted by the application, so that the database access is failed.

The method comprises the steps that when an application uses a logic connection object to submit an SQL request for the first time, the logic connection object does not have an associated database connection pool, a strategy management unit component is called to obtain a target database connection pool meeting a routing strategy, the target database connection pool can be directly associated with the logic connection object provided for the application, and mapping of connection of logic connection to an actual data source is achieved; when the application calls the close method, the connection of the target database connection pool is returned, the mapping association relation is released, and the logical connection object is recycled. When the SQL request is submitted for the second time by the application, the strategy management unit component is called again to obtain a target database connection pool meeting the routing strategy, if the target database connection pool is consistent with the obtained target database connection pool, the mapped data source is used for connecting and submitting the SQL, and if the target database connection pool is inconsistent with the obtained target database connection pool, the mapped data source connection object is returned and a new data source connection object is obtained for mapping association.

Fig. 6a schematically shows a flowchart of a logical connection object allocation method provided according to an embodiment of the present disclosure, and fig. 6b schematically shows a flowchart of a logical connection object recovery method provided according to an embodiment of the present disclosure. As shown in fig. 6a, including operations S310 to S330, operations S310 to S330 are performed before operation S210.

At operation 310, the available number of logical connection objects is obtained.

According to an embodiment of the present disclosure, the available number of logical connection objects is determined from the plurality of database connection pools of the multi-campus database.

In operation S320, when the available number of the logical connection objects is greater than or equal to a preset threshold, a logical connection object is allocated to the application.

In operation S330, when the available number of the logical connection objects is less than a preset threshold, a wait for connection instruction is returned to the application.

In one example, the available number of logical connection objects is related to the number of connectable databases in the database connection pool of the multi-campus database, for example, the multi-campus database includes 5 databases, and the maximum value of the connectable number of the database connection pool corresponding to each database is 20, and then the maximum value of the available number of logical connection objects is 100. The data access routing device determines the available number of the logical connection objects according to the implementation operation condition of the managed multiple database connection pools. When the available quantity is greater than or equal to a preset threshold value, for example, the preset threshold value may be 1, the current multi-campus database is represented as an available state, and a logical connection object can be allocated to an application in response to a data access request of an application program; and when the available number is smaller than a preset threshold value, representing that the connection number of the database connection pool corresponding to the current multi-park database reaches the maximum connection number, temporarily stopping database access, and returning a waiting instruction to the application until the available connection number exists in the database connection pool. By controlling the available number of the logical connection objects, abnormal database access caused by overflow of a database connection pool in a high-concurrency scene can be prevented, and the availability of the multi-campus database is improved.

As shown in fig. 6b, including operation S340 and operation S350, operations S340 to S350 are performed after operation S250.

In operation S340, the association relationship of the logical connection object is cancelled.

In operation S350, the logical connection object is reclaimed.

In an example, after the application finishes accessing the target database or meets a preset condition, the preset condition may be, for example, that the database connection duration reaches a preset threshold, the database connection is usually forcibly recycled due to security and availability of the database, and after the application calls the close method of the allocated logical connection to return the database connection, the connection management unit first calls the close method of the associated database connection pool to return the database connection pool connection, and recycles the logical connection object, and updates the available number of the logical connection object.

Based on the data access routing method, the disclosure also provides a data access routing device. The apparatus will be described in detail below with reference to fig. 7.

Fig. 7 schematically shows a block diagram of a data access routing device according to an embodiment of the present disclosure.

As shown in fig. 7, the data access routing apparatus 800 of this embodiment includes a logical connection object assignment module 810, a determination module 820, an association module 830, a database connection module 840, and a return module 850.

The logical connection object assignment module 810 is configured to assign a logical connection object to an application in response to a database access request by the application. In an embodiment, the logical connection object assignment module 810 may be configured to perform the operation S210 described above, which is not described herein again.

The determining module 820 is configured to determine a target database connection pool according to the database structured query statement and the preset routing policy rule. In an embodiment, the determining module 820 may be configured to perform the operation S220 described above, which is not described herein again.

The association module 830 is configured to establish an association relationship between the target database connection pool and the logical connection object. In an embodiment, the association module 830 may be configured to perform the operation S230 described above, and is not described herein again.

The database connection module 840 is configured to submit the database structured query statement to a target database corresponding to the target database connection pool according to the association relationship. In an embodiment, the database connection module 840 may be configured to perform the operation S240 described above, which is not described herein again.

The returning module 850 is used for obtaining the execution result and returning the execution result to the application. In an embodiment, the returning module 850 may be configured to perform the operation S250 described above, and is not described herein again.

According to an embodiment of the present disclosure, the determination module 820 includes a first determination submodule, an identification submodule, and a second determination submodule.

And the first determining sub-module is used for acquiring the database structured query statement submitted by the application. In an embodiment, the first determining submodule may be configured to perform operation S221 described above, and is not described herein again.

The identification submodule is used for identifying the table name and the table field in the database structured query statement. In an embodiment, the identification submodule may be configured to perform the operation S222 described above, and is not described herein again.

And the second determining submodule is used for determining a target database connection pool according to the table name, the table field, the table name matching rule and the table field matching rule. In an embodiment, the second determining submodule may be configured to perform operation S223 described above, and is not described herein again.

According to an embodiment of the present disclosure, the second determination submodule includes: a first determination unit and a second determination unit.

The first determining unit is used for determining that the database connection pool matched with the table field is the target database connection pool when the table name is determined to be matched with the table name matching rule and the table field is determined to be matched with the table field matching rule. In an embodiment, the first determining unit may be configured to perform operation S2221 described above, which is not described herein again.

And the second determining unit is used for determining the database connection pool matched with the table name as a target database connection pool when the table name is determined to be matched with the table name matching rule and the table field is not matched with the table field matching rule. In an embodiment, the second determining unit may be configured to perform operation S2222 described above, which is not described herein again.

According to an embodiment of the present disclosure, the first determination unit includes: a subunit is determined.

A determining subunit, configured to determine that the table field matches the table field matching rule when it is determined that at least one matching rule of the numeric field value size matching, the string field value matching, and the sub-string matching is successfully matched. In an embodiment, the determining subunit may be configured to perform the operation S2221 described above, which is not described herein again.

According to an embodiment of the present disclosure, the association module 830 includes: a third determination submodule, a fourth determination submodule, and a fifth determination submodule.

The third determining submodule is used for determining a current database connection pool associated with the logical connection object. In an embodiment, the third determining submodule may be configured to perform the operation S231 described above, and is not described herein again.

And the fourth determining submodule is used for updating the current association relationship of the logical connection object according to the target database connection pool and the logical connection object when the current database connection pool is determined to be inconsistent with the target database connection pool. In an embodiment, the fourth determining submodule may be configured to perform operation S232 described above, and is not described herein again.

And the fifth determining submodule is used for keeping the current association relationship of the logical connection object when the current database connection pool is determined to be consistent with the target database connection pool. In an embodiment, the fifth determining submodule may be configured to perform operation S233 described above, and is not described herein again.

According to an embodiment of the present disclosure, the fourth determination sub-module includes: an association relationship canceling unit and an association unit.

And the incidence relation canceling unit is used for canceling the current incidence relation of the logical connection object. In an embodiment, the association relationship canceling unit may be configured to perform operation S2321 described above, which is not described herein again.

And the association unit is used for reestablishing the association relationship between the target database connection pool and the logical connection object. In an embodiment, the associating unit may be configured to perform operation S2322 described above, which is not described herein again.

According to an embodiment of the present disclosure, further comprising: the device comprises an acquisition module, a first judgment module, a second judgment module, an association relation cancellation module and a recovery module.

The obtaining module is used for obtaining the available quantity of the logical connection objects, and the available quantity of the logical connection objects is determined according to the database connection pools of the multi-campus database; in an embodiment, the obtaining module may be configured to perform the operation S310 described above, which is not described herein again.

The first judging module is used for distributing the logic connection objects to the application when the available number of the logic connection objects is larger than or equal to a preset threshold value. In an embodiment, the first determining module may be configured to perform the operation S320 described above, which is not described herein again.

The second judging module is used for returning a connection waiting instruction to the application when the available number of the logic connection objects is smaller than a preset threshold value. In an embodiment, the second determining module may be configured to perform the operation S330 described above, and is not described herein again.

And the incidence relation canceling module is used for canceling the incidence relation of the logical connection object. In an embodiment, the association cancellation module may be configured to perform the operation S340 described above, which is not described herein again.

The recovery module is used for recovering the logic connection object. In an embodiment, the recycling module may be configured to perform the operation S350 described above, which is not described herein again.

According to an embodiment of the present disclosure, any plurality of the logical connection object allocating module 810, the determining module 820, the associating module 830, the database connecting module 840, and the returning module 850 may be combined into one module to be implemented, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the logical connection object assigning module 810, the determining module 820, the associating module 830, the database connecting module 840, and the returning module 850 may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or in any one of three implementations of software, hardware, and firmware, or in a suitable combination of any of them. Alternatively, at least one of the logical connection object assignment module 810, the determination module 820, the association module 830, the database connection module 840, and the return module 850 may be implemented, at least in part, as a computer program module that, when executed, may perform corresponding functions.

As shown in fig. 8, an electronic apparatus 900 according to an embodiment of the present disclosure includes a processor 901 which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM) 902 or a program loaded from a storage portion 908 into a Random Access Memory (RAM) 903. Processor 901 may comprise, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 901 may also include on-board memory for caching purposes. The processor 901 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.

In the RAM 903, various programs and data necessary for the operation of the electronic apparatus 900 are stored. The processor 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. The processor 901 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 902 and/or the RAM 903. Note that the programs may also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.

Electronic device 900 may also include input/output (I/O) interface 905, input/output (I/O) interface 905 also connected to bus 904, according to an embodiment of the present disclosure. The electronic device 900 may also include one or more of the following components connected to the I/O interface 905: an input portion 906 including a keyboard, a mouse, and the like; an output portion 907 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 908 including a hard disk and the like; and a communication section 909 including a network interface card such as a LAN card, a modem, or the like. The communication section 909 performs communication processing via a network such as the internet. The drive 910 is also connected to the I/O interface 905 as necessary. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 910 as necessary, so that a computer program read out therefrom is mounted into the storage section 908 as necessary.

The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement a data access routing method according to an embodiment of the present disclosure.

According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 902 and/or the RAM 903 described above and/or one or more memories other than the ROM 902 and the RAM 903.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method illustrated by the flow chart. When the computer program product runs in a computer system, the program code is used for causing the computer system to realize the data access routing method provided by the embodiment of the disclosure.

The computer program performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure when executed by the processor 901. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, and the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, and downloaded and installed through the communication section 909 and/or installed from the removable medium 911. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 909, and/or installed from the removable medium 911. The computer program, when executed by the processor 901, performs the above-described functions defined in the system of the embodiment of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.

The embodiments of the present disclosure are described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims

1. A data access routing method is applied to a multi-park database, and the multi-park database is configured with a plurality of database connection pools, and is characterized by comprising the following steps:

2. The data access routing method of claim 1, wherein the preset routing policy rules include a table name matching rule and a table field matching rule, and wherein determining the target database connection pool according to the database structured query statement and the preset routing policy rules comprises:

acquiring a database structured query statement submitted by an application;

3. The data access routing method of claim 2, wherein determining the target database connection pool according to the table name, the table field, and the table name matching rule and table field matching rule comprises:

4. The data access routing method of claim 3, wherein the table field matching rules include numeric field value size matching, string field value matching, and substring matching, and wherein the table field matching rules includes:

5. The data access routing method of claim 1, wherein associating the target database connection pool with the logical connection object comprises:

6. The data access routing method of claim 5, wherein the updating the current association relationship of the logical connection object according to the target database connection pool and the logical connection object comprises:

canceling the current association relation of the logical connection object;

7. The data access routing method of claim 1, further comprising, prior to assigning a logical connection object to the application:

8. The data access routing method of claim 1, further comprising, after the application finishes accessing the target database:

canceling the incidence relation of the logical connection object; and

and recovering the logic connection object.

9. A data access routing device for use with a multi-campus database, said multi-campus database having a plurality of database connection pools, said device comprising:

10. The data access routing device of claim 9, further comprising:

11. An electronic device, comprising:

one or more processors;

a storage device to store one or more programs,

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the data access routing method of any of claims 1-8.

12. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out a data access routing method according to any one of claims 1 to 8.

13. A computer program product comprising a computer program which, when executed by a processor, implements a data access routing method according to any one of claims 1 to 8.