CN113901083A - Heterogeneous data source operation resource analysis positioning method and equipment based on multiple analyzers - Google Patents
Heterogeneous data source operation resource analysis positioning method and equipment based on multiple analyzers Download PDFInfo
- Publication number
- CN113901083A CN113901083A CN202111074738.9A CN202111074738A CN113901083A CN 113901083 A CN113901083 A CN 113901083A CN 202111074738 A CN202111074738 A CN 202111074738A CN 113901083 A CN113901083 A CN 113901083A
- Authority
- CN
- China
- Prior art keywords
- data source
- structured query
- query statement
- user
- heterogeneous data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Machine Translation (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and equipment for analyzing and positioning heterogeneous data source operation resources based on a multi-analyzer, wherein the method comprises the following steps: after the heterogeneous data source management platform receives a structured query statement sent by a user, determining a target data source resolver corresponding to the data source type based on the data source type of the structured query statement; constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform; and performing authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to a user, so that the complexity of heterogeneous data source query is reduced on the premise of ensuring the flexibility and performance of heterogeneous data source query.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for resolving and locating heterogeneous data source operating resources based on multiple resolvers.
Background
With the rapid development of the internet and the industrial internet, a variety of data are stored by using various data systems. The unified heterogeneous data source management system can help the enterprise to better manage the data systems of the various systems of the enterprise.
At present, heterogeneous data source management systems in the market generally use a custom structured query grammar to complete a mode of mapping self resources to underlying resources or directly enable a user to specify operations to be performed and data resources to be accessed to locate the operations of the user and the resources to be accessed (operations: query, insertion and the like, operated resources: tables). The first method is to define own structured query grammar by user, obtain data resources to be queried by a user by analyzing the own structured query grammar, map the result to corresponding resources of a heterogeneous data source, and then perform operations such as permission verification based on the resources to be operated. Generally speaking, structured queries with high flexibility can be completed, but the implementation is complex, a complete set of structured query syntax needs to be defined, and the performance of the data query after the complete set of structured query syntax is usually reduced due to the fact that heterogeneous underlying data source characteristics are used. The second way is that the user gives up using the structured query syntax and directly specifies the resource to be accessed in a certain rule, and this way can directly locate the heterogeneous data source resource to be accessed, and can perform operations such as permission check based on the resource to be operated, but the flexibility of use of the heterogeneous data source can be reduced.
Therefore, how to guarantee the flexibility and performance of the query of the heterogeneous data source and reduce the complexity of the query is a technical problem to be solved at present.
Disclosure of Invention
The invention provides a multi-resolver-based analytic positioning method for heterogeneous data source operating resources, which is applied to a heterogeneous data source management platform comprising heterogeneous data source resolvers, wherein the heterogeneous data source resolvers comprise various types of data source resolvers and are used for solving the technical problems that the flexibility and performance of heterogeneous data source inquiry cannot be considered and the inquiry process is too complex in the prior art.
The method comprises the following steps:
after the heterogeneous data source management platform receives a structured query statement sent by a user, determining a target data source resolver corresponding to the data source type based on the data source type of the structured query statement;
constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform;
and carrying out authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to the user.
In some embodiments of the present application, parsing the structured query statement according to the abstract syntax tree specifically includes:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
In some embodiments of the present application, the performing authority verification and resource check on the analysis result specifically includes:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
In some embodiments of the present application, each of the data source parsers includes a parser abstraction interface corresponding to each data source, and the parser abstraction interface is generated by writing a corresponding syntax file for each data source through a syntax file of antlr4 and according to the syntax file.
In some embodiments of the present application, the abstract syntax tree is a multi-way tree.
Correspondingly, the invention also provides a device for resolving and positioning heterogeneous data source operating resources based on multiple resolvers, which is applied to a heterogeneous data source management platform comprising heterogeneous data source resolvers, wherein the heterogeneous data source resolvers comprise multiple types of data source resolvers, and the device comprises:
the determining module is used for determining a target data source resolver corresponding to a data source type based on the data source type of a structured query statement after the heterogeneous data source management platform receives the structured query statement sent by a user;
the analysis module is used for constructing an abstract syntax tree corresponding to the structured query statement based on the target data source analyzer, analyzing the structured query statement according to the abstract syntax tree, and returning an analysis result to the heterogeneous data source management platform;
and the execution module is used for carrying out authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning the execution result to the user.
In some embodiments of the present application, the parsing module is specifically configured to:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
In some embodiments of the present application, the execution module is specifically configured to:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
In some embodiments of the present application, each of the data source parsers includes a parser abstraction interface corresponding to each data source, and the parser abstraction interface is generated by writing a corresponding syntax file for each data source through a syntax file of antlr4 and according to the syntax file.
In some embodiments of the present application, the abstract syntax tree is a multi-way tree.
By applying the technical scheme, after the heterogeneous data source management platform receives a structured query statement sent by a user, a target data source resolver corresponding to the data source type is determined based on the data source type of the structured query statement; constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform; and performing authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to a user, so that the complexity of heterogeneous data source query is reduced and the query efficiency of the heterogeneous data source is improved on the premise of ensuring the flexibility and performance of the heterogeneous data source query.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart illustrating a method for resolving and locating heterogeneous data source operating resources based on multiple resolvers according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a heterogeneous data source management platform according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating an abstract syntax tree in an embodiment of the present invention;
fig. 4 shows a schematic structural diagram of a device for resolving location of heterogeneous data source operating resources based on multiple resolvers according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a method for analyzing and positioning heterogeneous data source operation resources based on multiple analyzers, which is applied to a heterogeneous data source management platform comprising heterogeneous data source analyzers, wherein the heterogeneous data source analyzers comprise multiple types of data source analyzers, and as shown in fig. 1, the method comprises the following steps:
step S101, after the heterogeneous data source management platform receives a structured query statement sent by a user, a target data source resolver corresponding to a data source type is determined based on the data source type of the structured query statement.
In this embodiment, as shown in fig. 2, the heterogeneous data source management platform includes heterogeneous data source parsers, and multiple types of data source parsers are arranged in the heterogeneous data source parsers, for example, an RPD parser, a PG parser, and the like, where the data source parser mentioned in this embodiment is only used to illustrate the principle of the present solution, and does not indicate that the data source parser in the present solution is only the relevant type mentioned in the present solution, and a person skilled in the art may flexibly set different types of data source parsers according to actual needs, and the type or number of the data source parsers is different and does not affect the protection scope of the present application.
When a user sends a structured query statement to a heterogeneous data source management platform, the structured query statement comprises a type of a data source, and a heterogeneous data source parser allocates the structured query statement to a target data source parser of the same type as the data source according to the type of the data source, wherein a Mysql database is used as the data source in the embodiment, and in a specific application scenario of the application, technicians can select other types of databases as the data source.
And step S102, constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform.
In this embodiment, after sending a structured query statement to a corresponding target data source parser, the target data source parser constructs an Abstract Syntax Tree corresponding to the structured query statement according to the structured query statement, where the Abstract Syntax Tree (Abstract Syntax Tree) is a Tree-shaped representation manner used to describe a Syntax structure of a program code, each node of the Syntax Tree represents a Syntax structure in the program code, and for example, a packet, a type, a modifier, an operator, an interface, and a return value may be a Syntax structure, and the structured query statement sent by a user is parsed through the Abstract Syntax Tree, and a parsing result is returned to the heterogeneous data source management platform.
In order to implement parsing of the structured query statement, in some embodiments of the present application, parsing the structured query statement according to the abstract syntax tree specifically includes:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
In this embodiment, the abstract syntax tree is subjected to depth-first traversal, the parsing result is generated according to the traversal result after the traversal is completed, the parsing result includes an operation corresponding to the structured query statement, that is, what operation processing needs to be performed by the user, and a resource of the operation, for example, if the user wants to delete the character "hello", the deletion is an operation corresponding to the structured query statement, and the "hello" is an operation resource, that is, a target that needs to be operated.
And step S103, performing authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to the user.
And after the permission check and the resource check are passed, the structured query statement is pushed to a bottom-layer heterogeneous data source for execution, and the execution result is returned to the user, so that the query request of the user is completed.
In order to perform permission check and resource check on the analysis result, in some embodiments of the present application, the permission check and resource check are performed on the analysis result, specifically:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
After the structured query statement is analyzed through the abstract syntax tree, whether a user has the authority to perform query operation and a target resource required by the user exists need to be determined, so that whether the user has the operation authority and whether the operation resource exists need to be judged, if the user has the operation authority and the operation resource exists, the structured query statement is pushed to a bottom-layer heterogeneous data source to be executed, an execution result is returned to the user, and if one of the operation authority and the operation resource exists is not satisfied, the current query of the user is failed, and query failure information is returned to the user.
In some embodiments of the present application, each of the data source parsers includes a parser abstraction interface corresponding to each data source, and the parser abstraction interface is generated by writing a corresponding syntax file for each data source through a syntax file of antlr4 and according to the syntax file.
In this embodiment, the heterogeneous data source parser is constructed in the following manner: various types of data source resolvers are arranged in the heterogeneous data source resolver; the parser of each data source is realized according to the structured query grammar of the data source, so as to parse different types of data source grammars. The steps of parsing different types of data source grammars are as follows: firstly, writing a grammar file for each data source through the grammar file of the antlr 4; secondly, generating a corresponding parser abstract interface according to the grammar file; finally, the parsing of the syntax is completed by programming the abstract interface.
And then, acquiring the operation to be performed by the query statement and the resource information required to be operated according to the programming implementation logic.
In some embodiments of the present application, the abstract syntax tree is a multi-way tree.
By applying the technical scheme, after the heterogeneous data source management platform receives a structured query statement sent by a user, a target data source resolver corresponding to the data source type is determined based on the data source type of the structured query statement; constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform; and performing authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to a user, so that the complexity of heterogeneous data source query is reduced and the query efficiency of the heterogeneous data source is improved on the premise of ensuring the flexibility and performance of the heterogeneous data source query.
In order to further illustrate the technical idea of the present invention, the technical solution of the present invention will now be described with reference to specific application scenarios.
The embodiment of the application provides a method for analyzing and positioning heterogeneous data source operation resources based on multiple analyzers, which comprises the following steps:
step one, a user inputs a structured query statement into a heterogeneous data source management system, for example: select from table 1.
The heterogeneous data source management platform comprises heterogeneous data source resolvers, and various types of data source resolvers are arranged in the heterogeneous data source resolvers.
And step two, the heterogeneous data source management platform sends the structured query statement select from table 1 and the data source type Mysql to the heterogeneous data source resolver.
When a user sends a structured query statement to the heterogeneous data source management platform, the structured query statement comprises the type of a data source, and the heterogeneous data source resolver distributes the structured query statement to a target data source resolver of the same type as the structured query statement according to the type of the data source.
And step three, the heterogeneous data source parser finds a Mysql grammar parser to parse the structured query statement select from table 1, and construct a corresponding grammar tree, wherein the grammar tree is shown in FIG. 3, the grammar tree is subjected to depth-first traversal, the traversal sequence is shown in a table I, and an parsing result { { op: select, resources: table 1} is obtained, the operation is select, and the resource is table 1.
And step four, the permission module can detect whether the user has a select permission of table 1 according to the information, and the resource detection module can also detect whether the resource of table 1 exists.
After the structured query statement is analyzed through the abstract syntax tree, it needs to be determined whether the user has the authority to perform query operation and target resources needed by the user exist, so that it needs to be determined whether the user has the operation authority and whether the operation resources exist
And step five, when the permission detection and the resource detection are passed, the heterogeneous data source management platform can push the structured query statement select from table 1 to the bottom heterogeneous data source for execution, and the completion result is returned to the client.
If the user has the operation authority and the operation resource exists, the structured query statement is pushed to a bottom-layer heterogeneous data source to be executed, an execution result is returned to the user, if the user has the operation authority and the operation resource exists, one of the operation authority and the operation resource does not satisfy the requirement, the user fails in the current query, and query failure information is returned to the user.
By applying the technical scheme, after the heterogeneous data source management platform receives a structured query statement sent by a user, a target data source resolver corresponding to the data source type is determined based on the data source type of the structured query statement; constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform; and performing authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to a user, so that the complexity of heterogeneous data source query is reduced and the query efficiency of the heterogeneous data source is improved on the premise of ensuring the flexibility and performance of the heterogeneous data source query.
The embodiment of the present application further provides a device for resolving and locating heterogeneous data source operating resources based on multiple resolvers, which is applied to a heterogeneous data source management platform including heterogeneous data source resolvers, where the heterogeneous data source resolvers include multiple types of data source resolvers, as shown in fig. 4, the device includes:
a determining module 401, configured to determine, after the heterogeneous data source management platform receives a structured query statement sent by a user, a target data source parser corresponding to a data source type based on the data source type of the structured query statement;
the parsing module 402 is configured to construct an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parse the structured query statement according to the abstract syntax tree, and return a parsing result to the heterogeneous data source management platform;
and the execution module 403 is configured to perform permission check and resource check on the analysis result, push the structured query statement to a bottom-layer heterogeneous data source for execution after the permission check and the resource check are passed, and return an execution result to the user.
In a specific application scenario of the present application, the parsing module 402 is specifically configured to:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
In a specific application scenario of the present application, the executing module 403 is specifically configured to:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
In a specific application scenario of the application, each data source parser includes a parser abstract interface corresponding to each data source, and the parser abstract interface is generated by writing a corresponding syntax file for each data source through a syntax file of antlr4 and according to the syntax file.
In a specific application scenario of the present application, the abstract syntax tree is a multi-way tree.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. The method for analyzing and positioning the operation resources of the heterogeneous data source based on the multiple analyzers is applied to a heterogeneous data source management platform comprising heterogeneous data source analyzers, wherein the heterogeneous data source analyzers comprise multiple types of data source analyzers, and the method comprises the following steps:
after the heterogeneous data source management platform receives a structured query statement sent by a user, determining a target data source resolver corresponding to the data source type based on the data source type of the structured query statement;
constructing an abstract syntax tree corresponding to the structured query statement based on the target data source parser, parsing the structured query statement according to the abstract syntax tree, and returning a parsing result to the heterogeneous data source management platform;
and carrying out authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning an execution result to the user.
2. The method of claim 1, wherein parsing the structured query statement according to the abstract syntax tree is specifically:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
3. The method of claim 2, wherein the performing the permission check and the resource check on the analysis result specifically comprises:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
4. The method as claimed in claim 1, wherein each of the data source parsers includes a parser abstraction interface corresponding to each data source, and the parser abstraction interface is generated by writing a corresponding syntax file for each data source through a syntax file of antlr4 and according to the syntax file.
5. The method of claim 1, wherein the abstract syntax tree is a multi-way tree.
6. An apparatus for resolving and locating heterogeneous data source operation resources based on multiple resolvers, which is applied to a heterogeneous data source management platform including heterogeneous data source resolvers including multiple types of data source resolvers, the apparatus comprising:
the determining module is used for determining a target data source resolver corresponding to a data source type based on the data source type of a structured query statement after the heterogeneous data source management platform receives the structured query statement sent by a user;
the analysis module is used for constructing an abstract syntax tree corresponding to the structured query statement based on the target data source analyzer, analyzing the structured query statement according to the abstract syntax tree, and returning an analysis result to the heterogeneous data source management platform;
and the execution module is used for carrying out authority verification and resource check on the analysis result, pushing the structured query statement to a bottom-layer heterogeneous data source for execution after the authority verification and the resource check are passed, and returning the execution result to the user.
7. The device of claim 6, wherein the parsing module is specifically configured to:
and performing depth-first traversal on the abstract syntax tree, and generating the analysis result according to the traversal result, wherein the analysis result comprises the operation and the operation resource corresponding to the structured query statement.
8. The device of claim 7, wherein the execution module is specifically configured to:
judging whether a user has an operation authority or not and whether the operation resource exists or not;
if the user has the operation authority and the operation resources exist, pushing the structured query statement to a bottom-layer heterogeneous data source for execution, and returning an execution result to the user;
and if the user does not have the operation authority or the operation resource does not exist, returning query failure information to the user.
9. The device of claim 6, wherein each data source parser comprises a parser abstraction interface corresponding to each data source, and the parser abstraction interface is generated by writing a corresponding grammar file for each data source through a grammar file of antlr4 and according to the grammar file.
10. The apparatus of claim 6, wherein the abstract syntax tree is a multi-way tree.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111074738.9A CN113901083B (en) | 2021-09-14 | 2021-09-14 | Heterogeneous data source operation resource analysis positioning method and equipment based on multiple resolvers |
| PCT/CN2021/134697 WO2023040056A1 (en) | 2021-09-14 | 2021-12-01 | Multi-parser-based method and device for parsing and positioning heterogeneous data source operation resource |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111074738.9A CN113901083B (en) | 2021-09-14 | 2021-09-14 | Heterogeneous data source operation resource analysis positioning method and equipment based on multiple resolvers |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113901083A true CN113901083A (en) | 2022-01-07 |
| CN113901083B CN113901083B (en) | 2023-05-12 |
Family
ID=79028262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111074738.9A Active CN113901083B (en) | 2021-09-14 | 2021-09-14 | Heterogeneous data source operation resource analysis positioning method and equipment based on multiple resolvers |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113901083B (en) |
| WO (1) | WO2023040056A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984266A (en) * | 2020-08-24 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Structural operation statement analysis method and device |
| WO2024066094A1 (en) * | 2022-09-27 | 2024-04-04 | 北京柏睿数据技术股份有限公司 | Cross-data-source visual construction method and system for database view |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117539912A (en) * | 2023-11-23 | 2024-02-09 | 武汉软件工程职业学院(武汉开放大学) | System, method and equipment for accelerating heterogeneous data source access |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080201293A1 (en) * | 2007-02-15 | 2008-08-21 | Cognos Incorporated | Multidimensional query simplification using data access service having local calculation engine |
| US8359305B1 (en) * | 2011-10-18 | 2013-01-22 | International Business Machines Corporation | Query metadata engine |
| US9081873B1 (en) * | 2009-10-05 | 2015-07-14 | Stratacloud, Inc. | Method and system for information retrieval in response to a query |
| CN110399388A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Data query method, system and equipment |
| CN110633292A (en) * | 2019-09-19 | 2019-12-31 | 上海依图网络科技有限公司 | Query method, device, medium, equipment and system for heterogeneous database |
| CN111078961A (en) * | 2019-12-24 | 2020-04-28 | 用友网络科技股份有限公司 | Multi-data source query driving system, method, device and storage medium |
| CN111949541A (en) * | 2020-08-14 | 2020-11-17 | 中国工商银行股份有限公司 | Multi-source database statement checking method and device |
| CN112579610A (en) * | 2020-12-23 | 2021-03-30 | 安徽航天信息有限公司 | Multi-data source structure analysis method, system, terminal device and storage medium |
| CN112699141A (en) * | 2020-12-29 | 2021-04-23 | 医渡云（北京）技术有限公司 | Data query method and device for multi-source heterogeneous data, storage medium and equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9747365B2 (en) * | 2014-06-30 | 2017-08-29 | Quixey, Inc. | Query understanding pipeline |
| CN108268512B (en) * | 2016-12-30 | 2020-07-31 | 中国移动通信集团上海有限公司 | Label query method and device |
| CN108009236B (en) * | 2017-11-29 | 2020-11-03 | 北京锐安科技有限公司 | Big data query method, system, computer and storage medium |
| CN112632095A (en) * | 2020-12-31 | 2021-04-09 | 中国农业银行股份有限公司 | Method and device for updating corresponding relation between interpreter and thread pool unit |
| CN112906050A (en) * | 2021-02-24 | 2021-06-04 | 中国联合网络通信集团有限公司 | Database security access control method and related device |
-
2021
- 2021-09-14 CN CN202111074738.9A patent/CN113901083B/en active Active
- 2021-12-01 WO PCT/CN2021/134697 patent/WO2023040056A1/en unknown
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080201293A1 (en) * | 2007-02-15 | 2008-08-21 | Cognos Incorporated | Multidimensional query simplification using data access service having local calculation engine |
| US9081873B1 (en) * | 2009-10-05 | 2015-07-14 | Stratacloud, Inc. | Method and system for information retrieval in response to a query |
| US8359305B1 (en) * | 2011-10-18 | 2013-01-22 | International Business Machines Corporation | Query metadata engine |
| CN110399388A (en) * | 2019-07-29 | 2019-11-01 | 中国工商银行股份有限公司 | Data query method, system and equipment |
| CN110633292A (en) * | 2019-09-19 | 2019-12-31 | 上海依图网络科技有限公司 | Query method, device, medium, equipment and system for heterogeneous database |
| CN111078961A (en) * | 2019-12-24 | 2020-04-28 | 用友网络科技股份有限公司 | Multi-data source query driving system, method, device and storage medium |
| CN111949541A (en) * | 2020-08-14 | 2020-11-17 | 中国工商银行股份有限公司 | Multi-source database statement checking method and device |
| CN112579610A (en) * | 2020-12-23 | 2021-03-30 | 安徽航天信息有限公司 | Multi-data source structure analysis method, system, terminal device and storage medium |
| CN112699141A (en) * | 2020-12-29 | 2021-04-23 | 医渡云（北京）技术有限公司 | Data query method and device for multi-source heterogeneous data, storage medium and equipment |
Non-Patent Citations (6)
| Title |
|---|
| "Multi-source heterogeneous data fusion", 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD) * |
| ANZHONG HUANG 等: "Two-stage adaptive integration of multi-source heterogeneous data based on an improved random subspace and prediction of default risk of microcredit", NEURAL COMPUTING AND APPLICATIONS * |
| 吴焕 等: "基于LINQ的多源异构数据查询中间件", 计算机工程 * |
| 宋伟: "环境大数据异构信息融合方法研究", 中国优秀硕士学位论文全文数据库 工程科技Ⅰ辑 * |
| 汪雪飞: "基于PostgreSQL的大规模分布式异构数据库统一访问研究", 中国优秀硕士学位论文全文数据库 信息科技辑 * |
| 蔡军 等: "面向气象水文信息整合的网格模型", 计算机工程与设计 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984266A (en) * | 2020-08-24 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Structural operation statement analysis method and device |
| WO2024066094A1 (en) * | 2022-09-27 | 2024-04-04 | 北京柏睿数据技术股份有限公司 | Cross-data-source visual construction method and system for database view |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113901083B (en) | 2023-05-12 |
| WO2023040056A1 (en) | 2023-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113901083B (en) | Heterogeneous data source operation resource analysis positioning method and equipment based on multiple resolvers | |
| US9122540B2 (en) | Transformation of computer programs and eliminating errors | |
| CN111626028A (en) | Report generation method, device and equipment based on function analysis and computer medium | |
| CN110688544A (en) | Method, device and storage medium for querying database | |
| CN113360519B (en) | Data processing method, device, equipment and storage medium | |
| CN111026670B (en) | Test case generation method, test case generation device and storage medium | |
| CN112560100A (en) | Data desensitization method and device, computer readable storage medium and electronic equipment | |
| CN112035443A (en) | Big data execution method, system, equipment and storage medium based on Linux platform | |
| CN112783867A (en) | Database optimization method for meeting real-time big data service requirements and cloud server | |
| CN114356964A (en) | Data blood margin construction method and device, storage medium and electronic equipment | |
| CN112988163B (en) | Intelligent adaptation method, intelligent adaptation device, intelligent adaptation electronic equipment and intelligent adaptation medium for programming language | |
| CN112000690B (en) | Method and device for analyzing structured operation statement | |
| CN113238739A (en) | Plug-in development and data acquisition method, device, electronic equipment and medium | |
| US20140359258A1 (en) | Declarative Configuration Elements | |
| CN116010461A (en) | Data blood relationship analysis method and device, storage medium and electronic equipment | |
| CN113821496B (en) | Database migration method, system, device and computer readable storage medium | |
| US20190317877A1 (en) | Application state monitoring | |
| CN114547083A (en) | Data processing method and device and electronic equipment | |
| CN114816420A (en) | Data processing method and device | |
| CN114691197A (en) | Code analysis method and device, electronic equipment and storage medium | |
| CN114064601B (en) | Storage process conversion method, device, equipment and storage medium | |
| Habibi et al. | Generating test as a web service (TaaWS) through a method-based attribute grammar | |
| CN116755684B (en) | OAS Schema generation method, device, equipment and medium | |
| CN117251472B (en) | Cross-source data processing method, device, equipment and storage medium | |
| CN113626423B (en) | Log management method, device and system of business database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 701, floor 7, building 3, courtyard 6, lizexi street, Chaoyang District, Beijing 100102 Applicant after: Beijing birui Data Technology Co.,Ltd. Address before: Room 701, floor 7, building 3, courtyard 6, lizexi street, Chaoyang District, Beijing 100102 Applicant before: WEIXUN BORAY DATA TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |