CN111259038B - Database query and data export method, system, medium and device - Google Patents

Database query and data export method, system, medium and device Download PDF

Info

Publication number
CN111259038B
CN111259038B CN202010048538.5A CN202010048538A CN111259038B CN 111259038 B CN111259038 B CN 111259038B CN 202010048538 A CN202010048538 A CN 202010048538A CN 111259038 B CN111259038 B CN 111259038B
Authority
CN
China
Prior art keywords
sql
database
queried
data
script
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010048538.5A
Other languages
Chinese (zh)
Other versions
CN111259038A (en
Inventor
文凭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Si Tech Information Technology Co Ltd
Original Assignee
Beijing Si Tech Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Si Tech Information Technology Co Ltd filed Critical Beijing Si Tech Information Technology Co Ltd
Priority to CN202010048538.5A priority Critical patent/CN111259038B/en
Publication of CN111259038A publication Critical patent/CN111259038A/en
Application granted granted Critical
Publication of CN111259038B publication Critical patent/CN111259038B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/242Query formulation
    • G06F16/2433Query languages
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention relates to a database query and data export method, a system, a medium and equipment, wherein the method comprises the following steps: generating a dynamic SQL script conforming to SQL characteristics of a database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance; submitting the dynamic SQL script to a database to be queried, and receiving an SQL result set fed back by the database to be queried, which is obtained by executing the dynamic SQL script; and writing the SQL result set into an Excel file under a preset export path. The database query and data export method provided by the invention has the advantages that the SQL characteristics of different databases are packaged in advance, the dynamic SQL script meeting the SQL characteristics of the different databases is written, the data query of various databases with different types can be realized, and the data can be exported rapidly.

Description

Database query and data export method, system, medium and device
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method, a system, a medium, and an apparatus for database query and data export.
Background
In the prior art, a database query and data export tool can only aim at a specific database, for example, an export tool aiming at Oracle can only realize data query and data export of Oracle, and cannot realize data query and data export of Mysql and Hive. However, in the actual use process, the data analyst often needs to query different types of databases, and if one query tool is replaced for each database query, the operation is complicated, and the query efficiency is low.
Disclosure of Invention
The invention aims to solve the technical problem of providing a database query and data export method, a system, a medium and equipment aiming at the defects of the prior art.
In order to solve the above technical problems, an embodiment of the present invention provides a database query and data export method, including: generating a dynamic SQL script conforming to SQL characteristics of a database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance; submitting the dynamic SQL script to a database to be queried, and receiving an SQL result set fed back by the database to be queried, which is obtained by executing the dynamic SQL script; and writing the SQL result set into an Excel file under a preset export path.
In order to solve the above technical problems, an embodiment of the present invention provides a database query and data export system, including: the script generation module is used for generating a dynamic SQL script conforming to SQL characteristics of the database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance; the data query module is used for submitting the dynamic SQL script to a database to be queried and receiving an SQL result set fed back by the database to be queried and obtained by executing the dynamic SQL script; and the data export module is used for writing the SQL result set into an Excel file under a preset export path.
To solve the above technical problem, an embodiment of the present invention provides a computer readable storage medium, which includes instructions that when executed on a computer, cause the computer to execute the database query and data export method according to the above technical solution.
In order to solve the above technical problems, an embodiment of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the database query and data export method described in the above technical scheme when executing the program.
The beneficial effects of the invention are as follows: SQL features of different databases are packaged in advance, dynamic SQL scripts meeting the SQL features of the different databases are written, SQL examination is completed before database query, SQL scripts meeting the requirements are generated, data query of various databases of different types can be realized, and data can be rapidly exported. The method has the advantages that one query tool does not need to be replaced for querying one database, the study cost of a data analyst is reduced, the operation is simple and convenient, and the query efficiency is high.
Additional aspects of the invention and advantages thereof will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
FIG. 1 is a flowchart of a database query and data export method according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for generating dynamic SQL scripts according to an embodiment of the present invention;
FIG. 3 is a flowchart of a data export method according to an embodiment of the present invention;
FIG. 4 is a block diagram of a database query and data export system according to an embodiment of the present invention.
Detailed Description
The principles and features of the present invention are described below with reference to the drawings, the examples are illustrated for the purpose of illustrating the invention and are not to be construed as limiting the scope of the invention.
The embodiment of the invention is developed based on Python, and supports Windows and Linux at present. The external package matched with the Python is pre-imported, namely, the software development kit SDK (Software Development Kit) imported into the database to be queried. The application based on Python provides the name and version request file of the external program package required by the application, and further encapsulates the API of the external program.
FIG. 1 is a flowchart of a database query and data export method according to an embodiment of the present invention. As shown in fig. 1, the method includes:
110. generating a dynamic SQL script conforming to SQL characteristics of a database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance;
120. submitting the dynamic SQL script to a database to be queried, and receiving an SQL result set fed back by the database to be queried, which is obtained by executing the dynamic SQL script;
130. and writing the SQL result set into an Excel file under a preset export path.
Specifically, the preset export path may be determined according to the received export directory parameters, and if the export directory parameters are not received, the currently active directory is defaulted to be the preset export path.
In the embodiment, SQL features of different databases are packaged in advance, dynamic SQL scripts meeting the SQL features of the different databases are written, SQL inspection is completed before database inquiry, and SQL scripts meeting requirements are generated, so that data inquiry of various databases of different types can be realized, and data can be rapidly exported. The method has the advantages that one query tool does not need to be replaced for querying one database, the study cost of a data analyst is reduced, the operation is simple and convenient, and the query efficiency is high. In the embodiment, single-table and multi-table query of Hive, oracle and Mysql databases and Excel file export of query results can be realized.
Optionally, in one embodiment, as shown in fig. 2, the generating a dynamic SQL script that conforms to the SQL characteristics of the database to be queried includes:
111. generating an initial SQL script, acquiring SQL characteristics of a database to be queried, and carrying out grammar check on the initial SQL script according to the SOL characteristics;
specifically, SQL features are grammars and functions specific to the database to be queried. For example, the Oracle nvl function, row_number (), etc. do not apply at Mysql; for example, the Oracle decode function is different from the function of the decode of Hive.
For example, the initial SQL script is selected card no as card number from ods. Bss hk d rs card info presell where deal time= '20191229' limit10.
When grammar checking is carried out, whether a field card no exists in the table ods, bss_hk_d_rs_card_info_presell, whether a login user has query authority of an ods database, whether a query target database has related abnormal detection points including functions and the like are checked, for example, if the statement Oracle does not have limit, an abnormality is reported, and when Oracle is queried, limit10 is modified to be where rowum < 11; and MySQL and Hive will not report errors.
112. And modifying the initial SQL script according to the checking result until the SQL characteristic of the database to be queried is met, and obtaining a dynamic SQL script.
In the above embodiment, the efficiency of error exception return is improved by SQL grammar checking, for example, the execution of Hive's SQL is a time-consuming operation that needs to start MapReduce, regardless of how simple a statement starts MapReduce. In the embodiment, the SQL script is submitted to the database to be queried for grammar checking, so that the prior checking can be realized without starting database connection, and the query efficiency is improved.
Optionally, before submitting the dynamic SQL script to the database to be queried, the method further comprises: and acquiring the derived path parameters, checking whether the Excel file under the corresponding path has the write-in authority according to the derived path parameters, and changing the derived path if the Excel file has no write-in authority.
In particular, the export path parameter may be an incoming export directory parameter, and if the export directory parameter is not incoming, the directory parameter of the currently active directory is defaulted to be the export path parameter. Checking whether the derived path parameters have write-in authority, carrying out abnormal alarm on the condition that no write-in authority exists, and exiting program execution.
For example: current directory: the/home/etlrun/python_src/utils;
executing a command: since the command does not enter the absolute path of the sql file, the name and directory of export excel are not specified, the program checks by default whether the current directory has write permission, whether the current directory has a file of y0000002.sql, if the check result is not satisfied, an exception is reported, and the execution is exited.
In the above embodiment, the authority check is performed in advance, so that whether the requirement is met or not can be checked before a large number of IO operations are executed, and the problem that cache data cannot be brushed into a disk after the IO operations are completed is avoided.
Optionally, in one embodiment, as shown in fig. 3, the writing the SQL result set into the Excel file under the preset export path includes:
131. and acquiring the field type, the field alias and/or the field name of the SQL result set.
132. And adapting an Excel data format for the field type according to a preset mapping relation.
Specifically, the dictionary library may be utilized to record mapping relationships, and the dictionary library of the mapping relationships may be updated and modified when there is an incorrect mapping. Common mapping types include, for example: the database type is varchar, string, text, and the corresponding Excel format is text; the database types are number, decimal and int types, and the corresponding Excel format is a numeric type (when decimal, 2 bits are reserved for rounding by default); the database types are timestamp and date types, and the corresponding Excel format is date, time or text type.
133. And writing the field alias and/or the field name into a first column of the Excel file as a title.
Specifically, a field alias may be automatically written to the first column of the Excel file as a title. If no alias is provided, the field name is written to the first column of the Excel file as a title by default. For example, in step 111, the field card_no has an alias of "card number", and if the output Excel file corresponds to a column with a title of "card number", the field name card_no is displayed.
134. And writing the SQL result set into an Excel file in the adaptive Excel data format.
In the prior art, the traditional database data export is generally in the formats of TXT, CSV and the like, format conversion is needed when Excel is used for opening, the operation is troublesome, and the user experience is low.
In the embodiment, the data type of the database is automatically adapted to the Excel data type when the data is exported, the data is directly exported in the adapted data format, format conversion is not needed when the file is opened, the efficiency of exporting the Excel data is improved, and the user experience is improved.
Optionally, before writing the SQL result set in the Excel file in the adapted Excel data format, the method further includes: and according to the coding format of the database to be queried, unified coding regularity of the derived content is carried out on the SQL result set.
Since windows has a corresponding suggestion in processing Unicode files, microsoft suggests that all Unicode files should start with ZERO WIDTH NOBREAK SPACE (u+feff) characters. When the database is Unicode coding such as utf-8, the derived content needs to be coded, and the characteristics of windows suggestion are added.
In the above embodiment, after the encoding is regular, the problem that multi-byte character strings (such as chinese, japanese, etc.) are displayed in excel due to different encoding formats is effectively avoided.
Optionally, when the SQL result set is written into an Excel file in the adapted Excel data format, the method further includes: and splitting and writing the SQL result set into a data sheet page of the Excel file according to a preset splitting rule.
It should be noted that when data is written into Excel, the SQL result set can be split according to the version of the Excel file and the preset splitting rule such as the number of data written into each Sheet page, and the split back-end SQL result set is written into different data sheets. For example, there are 10 ten thousand pieces of data, the 2003 edition is divided into 2 data sheet pages, and one data sheet page is after the 2003 edition. For example, it is further specified that each data sheet also stores 5 ten thousand pieces of data, and that 10 ten thousand pieces of data need to be stored in two data sheet pages.
In the above embodiment, the SQL result set is split and written into the data sheet page of the Excel file according to the preset splitting rule, so that flexible storage of query data can be realized.
Optionally, in an embodiment, writing the dynamic SQL script to a sheet page subsequent to the data sheet page is further included.
In the above embodiment, the dynamic SQL script is written into a sheet page behind the data sheet page, so that the next operation and data check are facilitated.
The database query and data export methods provided according to the embodiments of the present invention are described in detail above with reference to fig. 1 to 3. The database query and data export system provided in the embodiment of the present invention is described in detail below with reference to fig. 4.
As shown in fig. 4, an embodiment of the present invention further provides a database query and data export system, including: the system comprises a script generation module, a data query module and a data export module.
The script generation module is used for generating a dynamic SQL script conforming to SQL characteristics of the database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance;
the data query module is used for submitting the dynamic SQL script to a database to be queried and receiving an SQL result set fed back by the database to be queried and obtained by executing the dynamic SQL script;
and the data export module is used for writing the SQL result set into an Excel file under a preset export path.
In the embodiment, SQL features of different databases are packaged in advance, dynamic SQL scripts meeting the SQL features of the different databases are written, data query of various databases of different types can be realized, and data can be rapidly exported. The method has the advantages that one query tool does not need to be replaced for querying one database, the study cost of a data analyst is reduced, the operation is simple and convenient, and the query efficiency is high.
Optionally, the script generation module is specifically configured to: generating an initial SQL script, acquiring SQL characteristics of a database to be queried, and carrying out grammar check on the initial SQL script according to the SOL characteristics; and modifying the initial SQL script according to the checking result until the SQL characteristic of the database to be queried is met, and obtaining a dynamic SQL script.
Optionally, the system further comprises a derived path acquisition module, which is used for acquiring derived path parameters, checking whether the Excel file under the corresponding path has the write permission according to the derived path parameters, and changing the derived path if the Excel file has no write permission.
Optionally, the data export module is specifically configured to: acquiring a field type, a field alias and/or a field name of the SQL result set; according to a preset mapping relation, an Excel data format is adapted for the field type; writing the field alias and/or the field name into a first column of an Excel file as a title; and writing the SQL result set into an Excel file in the adaptive Excel data format.
Optionally, the system further comprises a coding normalization module, which is used for performing unified coding normalization of the derived content on the SQL result set according to the coding format of the database to be queried.
Optionally, the data export module is further configured to: and splitting and writing the SQL result set into a data sheet page of the Excel file according to a preset splitting rule.
Optionally, the data export module is further configured to write the dynamic SQL script to a sheet page following the data sheet page.
The embodiment of the invention also provides a computer readable storage medium, which comprises instructions, when the instructions run on a computer, cause the computer to execute the database query and data export method according to the embodiment.
The embodiment of the invention provides a computer device, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the database query and data export method described in the embodiment is realized when the processor executes the program.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and units described above may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment of the present invention.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention is essentially or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing description of the preferred embodiments of the invention is not intended to limit the invention to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims (8)

1. A method for database query and data export, comprising:
generating a dynamic SQL script conforming to SQL characteristics of a database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance; pre-packaging SQL characteristics of different databases, and writing dynamic SQL scripts meeting the SQL characteristics of the different databases;
the generating the dynamic SQL script conforming to the SQL characteristic of the database to be queried comprises the following steps:
generating an initial SQL script, acquiring SQL characteristics of a database to be queried, and carrying out grammar check on the initial SQL script according to the SQL characteristics;
modifying the initial SQL script according to the checking result until the SQL characteristic of the database to be queried is met, and acquiring a dynamic SQL script;
submitting the dynamic SQL script to a database to be queried, and receiving an SQL result set fed back by the database to be queried, which is obtained by executing the dynamic SQL script;
writing the SQL result set into an Excel file under a preset export path;
and writing the dynamic SQL script into a sheet page behind the data sheet page of the Excel file.
2. The method for querying and exporting data from database according to claim 1, wherein before submitting the dynamic SQL script to the database to be queried, further comprises: and acquiring the derived path parameters, checking whether the Excel file under the corresponding path has the write-in authority according to the derived path parameters, and changing the derived path if the Excel file has no write-in authority.
3. The method for querying and exporting data from a database according to any of claims 1 to 2, wherein writing the SQL result set into an Excel file under a preset export path comprises:
acquiring a field type, a field alias and/or a field name of the SQL result set;
according to a preset mapping relation, an Excel data format is adapted for the field type;
writing the field alias and/or the field name into a first column of an Excel file as a title;
and writing the SQL result set into an Excel file in the adaptive Excel data format.
4. The method of claim 3, further comprising, prior to writing the SQL result set in the Excel file in the adapted Excel data format: and according to the coding format of the database to be queried, unified coding regularity of the derived content is carried out on the SQL result set.
5. The method for querying and exporting data from a database according to claim 3, wherein when writing the SQL result set into an Excel file in the adapted Excel data format, the method further comprises: and splitting and writing the SQL result set into a data sheet page of the Excel file according to a preset splitting rule.
6. A database query and data export system comprising:
the script generation module is used for generating a dynamic SQL script conforming to SQL characteristics of the database to be queried; the SQL characteristic of the database to be queried is obtained by acquiring and packaging an SDK of the database to be queried in advance; pre-packaging SQL characteristics of different databases, and writing dynamic SQL scripts meeting the SQL characteristics of the different databases;
the generating the dynamic SQL script conforming to the SQL characteristic of the database to be queried comprises the following steps:
generating an initial SQL script, acquiring SQL characteristics of a database to be queried, and carrying out grammar check on the initial SQL script according to the SQL characteristics;
modifying the initial SQL script according to the checking result until the SQL characteristic of the database to be queried is met, and acquiring a dynamic SQL script;
the data query module is used for submitting the dynamic SQL script to a database to be queried and receiving an SQL result set fed back by the database to be queried and obtained by executing the dynamic SQL script;
the data export module is used for writing the SQL result set into an Excel file under a preset export path; and writing the dynamic SQL script into a sheet page behind the data sheet page of the Excel file.
7. A computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform the database query and data export method according to any of claims 1-5.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the database query and data export method of any of claims 1-5 when the program is executed.
CN202010048538.5A 2020-01-16 2020-01-16 Database query and data export method, system, medium and device Active CN111259038B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010048538.5A CN111259038B (en) 2020-01-16 2020-01-16 Database query and data export method, system, medium and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010048538.5A CN111259038B (en) 2020-01-16 2020-01-16 Database query and data export method, system, medium and device

Publications (2)

Publication Number Publication Date
CN111259038A CN111259038A (en) 2020-06-09
CN111259038B true CN111259038B (en) 2023-05-30

Family

ID=70950632

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010048538.5A Active CN111259038B (en) 2020-01-16 2020-01-16 Database query and data export method, system, medium and device

Country Status (1)

Country Link
CN (1) CN111259038B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112784553A (en) * 2020-12-31 2021-05-11 语联网(武汉)信息技术有限公司 Method and device for exporting data as Excel document
CN114844698A (en) * 2022-04-29 2022-08-02 深圳极联软件有限公司 Distributed big data safety management and control system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN1641639A (en) * 2004-01-12 2005-07-20 英业达股份有限公司 Multi data base query system and method thereof
CN101944084A (en) * 2009-07-09 2011-01-12 镇江华扬信息科技有限公司 Database automatic operation system based on SQL script and FTP transmission technique
CN105868204A (en) * 2015-01-21 2016-08-17 中国移动(深圳)有限公司 Method and apparatus for converting script language SQL of Oracle
CN109063057A (en) * 2018-07-20 2018-12-21 玖富金科控股集团有限责任公司 Data base query method, terminal, server, computer-readable medium and equipment
CN110597844A (en) * 2019-08-14 2019-12-20 中国平安财产保险股份有限公司 Heterogeneous database data unified access method and related equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050222990A1 (en) * 2004-04-06 2005-10-06 Milne Kenneth T Methods and systems for using script files to obtain, format and disseminate database information
US20100293524A1 (en) * 2009-05-12 2010-11-18 International Business Machines, Corporation Development environment for managing database aware software projects
US8176037B2 (en) * 2009-11-16 2012-05-08 Dell Products L.P. System and method for SQL query load balancing
CN101706810A (en) * 2009-11-23 2010-05-12 北京中创信测科技股份有限公司 Method and device for querying databases
CN104123374B (en) * 2014-07-28 2017-09-29 北京京东尚科信息技术有限公司 The method and device of aggregate query in distributed data base
CN110162544B (en) * 2019-05-30 2022-05-27 口碑(上海)信息技术有限公司 Heterogeneous data source data acquisition method and device
CN110688544A (en) * 2019-10-17 2020-01-14 北京锐安科技有限公司 Method, device and storage medium for querying database

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1641639A (en) * 2004-01-12 2005-07-20 英业达股份有限公司 Multi data base query system and method thereof
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN101944084A (en) * 2009-07-09 2011-01-12 镇江华扬信息科技有限公司 Database automatic operation system based on SQL script and FTP transmission technique
CN105868204A (en) * 2015-01-21 2016-08-17 中国移动(深圳)有限公司 Method and apparatus for converting script language SQL of Oracle
CN109063057A (en) * 2018-07-20 2018-12-21 玖富金科控股集团有限责任公司 Data base query method, terminal, server, computer-readable medium and equipment
CN110597844A (en) * 2019-08-14 2019-12-20 中国平安财产保险股份有限公司 Heterogeneous database data unified access method and related equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于SQL Server数据库的通用查询系统的设计与实现;王俊峰;丁静;魏锦;;乌鲁木齐职业大学学报(人文社会科学版)(04);全文 *

Also Published As

Publication number Publication date
CN111259038A (en) 2020-06-09

Similar Documents

Publication Publication Date Title
CN111522816B (en) Data processing method, device, terminal and medium based on database engine
US6560772B1 (en) Method, system, and program for accessing data in different environments
KR101755365B1 (en) Managing record format information
WO2022126983A1 (en) Electronic report file export method, apparatus and device, and storage medium
CN111259038B (en) Database query and data export method, system, medium and device
CN109388523B (en) Method for recovering MySQL database based on binary log file
CN111078657A (en) Service log query method, system, medium and equipment of distributed system
CN112231407B (en) DDL synchronization method, device, equipment and medium of PostgreSQL database
CN112000986A (en) Data desensitization method, device, equipment and storage medium
CN112306549A (en) Interface document configuration method, device, equipment and storage medium
CN108388606B (en) Method for checking base table field names in Sql sentences and computer equipment
EP2904520B1 (en) Reference data segmentation from single to multiple tables
CN116226170A (en) Database statement conversion method and device, electronic equipment and storage medium
KR20220088958A (en) Systems and methods for managing connections in a scalable cluster
CN111291074A (en) Database query method, system, medium and device
US20200097458A1 (en) Metadata validation tool
US7945529B2 (en) Apparatus and method for performing table comparisons
CN114116268A (en) Method and device for checking Flink SQL statement, computer equipment and storage medium
CN111984671B (en) Method for generating view script
CN117171030A (en) Method, device, equipment and storage medium for detecting software running environment
CN117112663A (en) Log processing method, device, equipment and storage medium
CN115310127A (en) Data desensitization method and device
CN116821186A (en) Query statement processing method and device, equipment and storage medium
JIANG et al. LILAC: Log Parsing using LLMs with Adaptive Parsing Cache
CN114694786A (en) Medical data query method, device, equipment and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant