CN112364047A - Presto-based dynamic data processing method and cross-library query method - Google Patents

Presto-based dynamic data processing method and cross-library query method Download PDF

Info

Publication number
CN112364047A
CN112364047A CN202011210164.9A CN202011210164A CN112364047A CN 112364047 A CN112364047 A CN 112364047A CN 202011210164 A CN202011210164 A CN 202011210164A CN 112364047 A CN112364047 A CN 112364047A
Authority
CN
China
Prior art keywords
presto
data source
information
data
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011210164.9A
Other languages
Chinese (zh)
Other versions
CN112364047B (en
Inventor
李钊
孙浩
孙露
杨春
魏静
胡传会
陈通
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Huazhi Talent Technology Co ltd
Original Assignee
Shandong Ecloud Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Ecloud Information Technology Co ltd filed Critical Shandong Ecloud Information Technology Co ltd
Priority to CN202011210164.9A priority Critical patent/CN112364047B/en
Publication of CN112364047A publication Critical patent/CN112364047A/en
Application granted granted Critical
Publication of CN112364047B publication Critical patent/CN112364047B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/242—Query formulation
    • G06F16/2433—Query languages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

The present disclosure provides a Presto-based dynamic data processing method and a cross-library query method, wherein the cross-library query method comprises the following steps: storing data source information by adopting at least one database type, and designating a user-defined table; monitoring the user-defined table by using a CANAL component, and acquiring data source registration information in real time; the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto; dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format; the method supports Presto inquire the multi-source heterogeneous data in an ANSI _ SQL mode in a jdbc mode, solves the problem of data fusion processing stored in different data structures, and improves the efficiency of cross-database data inquiry and processing.

Description

Presto-based dynamic data processing method and cross-library query method
Technical Field
The disclosure relates to the technical field of data processing, and in particular relates to a Presto-based dynamic data processing method and a cross-library query method.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
With the increasing social informatization level, data is explosively increased, meanwhile, various platforms or systems are built in governments and enterprises to support own services, but different platforms or systems are mostly designed by technical considerations or different developers, system data mostly adopt different data storage modes, and how to realize data analysis on data stored on different data structures becomes a problem which needs to be solved urgently.
The inventor of the present disclosure finds that, most of data analysis tools on the market now adopt a certain type of database or a certain data structure, which requires a user to use a data synchronization tool to assemble data in advance, or to modify an original system or platform to become a unified data source, and then perform data analysis.
Disclosure of Invention
In order to solve the defects of the prior art, the method and the cross-database query method for processing dynamic data based on Presto are provided by the disclosure, a user only needs to register a corresponding data source in a service system, information of a database is filled in a base table mode, the added data source can be displayed in real time by using Presto once register a certain database, and the method and the system support Presto query multi-source heterogeneous data in an ANSI _ SQL mode in a jdbc mode, so that the problem of data fusion processing stored in different data structures is solved, and the efficiency of cross-database data query and processing is improved.
In order to achieve the purpose, the following technical scheme is adopted in the disclosure:
the first aspect of the disclosure provides a Presto-based dynamic data processing method.
A Presto-based dynamic data processing method comprises the following steps:
storing data source information by adopting at least one database type, and designating a user-defined table;
monitoring the user-defined table by using a CANAL component, and acquiring data source registration information in real time;
the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
and dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format.
As some possible implementation manners, a MYSQL database is used for data source information storage.
As a further limitation, a binlog log of MYSQL is opened, and a CANAL component is matched to monitor a custom table registered by a data source.
As some possible implementations, the information of the database is encrypted using an asymmetric encryption algorithm.
As some possible implementation modes, the data source registration information is collected in real time based on the client end of the Presto adding the built-in CANAL.
As some possible implementation modes, an Oracle database or a Hive database is adopted for data source information storage.
A second aspect of the present disclosure provides a Presto-based cross-library query method.
A cross-library query method based on Presto comprises the following steps:
storing data source information by adopting at least one database type, and designating a user-defined table;
monitoring the user-defined table by using a CANAL component, and acquiring data source registration information in real time;
the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format;
presto uses jdbc to perform code integration, and uses ANSI _ SQL to query multi-source heterogeneous data.
As possible implementation modes, a MYSQL database is adopted for storing data source information, a binlog log of MYSQL is opened, and a CANAL component is matched for monitoring a self-defined table registered by a data source.
As some possible implementations, the information of the database is encrypted using an asymmetric encryption algorithm.
As some possible implementation modes, the data source registration information is collected in real time based on the client end of the Presto adding the built-in CANAL.
As some possible implementation modes, an Oracle database or a Hive database is adopted for data source information storage.
A third aspect of the disclosure provides a Presto-based cross-repository query system.
A Presto-based cross-repository query system, comprising:
a pre-data source registration module configured to: storing data source information by adopting at least one type of database, and designating a custom table;
a data source registration listening module configured to: monitoring a self-defined table of data source registration in a database by using a CANAL component, and acquiring data source registration information in real time;
a data source registration information conversion module configured to: the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
a dynamic data processing module configured to: dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format;
a cross-repository data query module configured to: presto uses jdbc to perform code integration, and uses ANSI _ SQL to query multi-source heterogeneous data.
A fourth aspect of the present disclosure provides a computer-readable storage medium, on which a program is stored, which when executed by a processor, implements the steps in the Presto-based cross-library query method according to the second aspect of the present disclosure.
A fifth aspect of the present disclosure provides an electronic device, which includes a memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps in the Presto-based cross-library query method according to the second aspect of the present disclosure.
Compared with the prior art, the beneficial effect of this disclosure is:
1. according to the method, the system, the medium or the electronic equipment disclosed by the disclosure, a user only needs to register a corresponding data source in a business system, information of the database is filled in a form of the database table, and once the user registers a certain database, the added, deleted or modified data source can be displayed in real time by using Presto improve the efficiency of data processing.
2. The method, the system, the medium or the electronic equipment disclosed by the disclosure support that Presto queries multi-source heterogeneous data in an ANSI _ SQL mode in a jdbc mode, solve the problem of data fusion processing stored in different data structures, and improve the efficiency of cross-database data query and processing.
Advantages of additional aspects of the disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure and are not to limit the disclosure.
Fig. 1 is a schematic flow chart of a Presto-based cross-library query method according to embodiment 2 of the present disclosure.
Detailed Description
The present disclosure is further described with reference to the following drawings and examples.
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the disclosure. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present disclosure. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.
Example 1:
as shown in fig. 1, embodiment 1 of the present disclosure provides a method for dynamic data processing based on Presto, including the following steps:
step 1.1: the prepositive data source is registered.
And (3) from the aspect of facilitating service integration, using MYSQL as data source information registration storage, and specifying a user-defined table, wherein the table structure is detailed in table 1, and in cooperation with step 1.3, using the information of the encrypted database of the asymmetric encryption algorithm ensures the security of the database information, opening the binlog log of MYSQL, and in cooperation with step 1.2, realizing monitoring of data source registration.
Table 1: and (5) customizing the table structure of the table.
id Watch main key
info Data source information
catalogName Data source name
creator Data source creator
connecterName Data source type
Step 1.2: and registering and monitoring a data source.
The method is based on a client end of a Presto added with a built-in CANAL, collects the condition of data source registration in real time, transmits the information of addition, deletion or modification of the data source registration table to the Presto through the CANAL and converts the information into catalogConfig format which can be identified by the Presto.
Step 1.3: and converting the data source registration information.
The method reduces CANAL monitoring built in Presto into catalogConfig which can be identified by Presto.
Step 1.4: and dynamically registering data source information.
And (3) modifying the original data source registration method of Presto, and dynamically realizing the addition, deletion or modification of the data source of Presto through the implementation of catalogConfig converted from the data in the step 1.3.
Example 2:
as shown in fig. 1, embodiment 2 of the present disclosure provides a cross-library query method based on Presto, including the following steps:
step 2.1: the prepositive data source is registered.
From the perspective of facilitating service integration, MYSQL is used as data source information registration storage, and a user-defined table is specified, the table structure is detailed in table 1 in embodiment 1, and in cooperation with step 2.3, information of the database is encrypted by using an asymmetric encryption algorithm, so that the security of the database information is ensured, binlog logs of MYSQL are opened, and in cooperation with step 2.2, monitoring of data source registration is achieved.
Step 2.2: and registering and monitoring a data source.
The method is based on a client end of a Presto added with a built-in CANAL, collects the condition of data source registration in real time, transmits the information of addition, deletion or modification of the data source registration table to the Presto through the CANAL and converts the information into catalogConfig format which can be identified by the Presto.
Step 2.3: and converting the data source registration information.
The method reduces CANAL monitoring built in Presto into catalogConfig which can be identified by Presto.
Step 2.4: and dynamically registering data source information.
And (3) modifying the original data source registration method of Presto, and dynamically realizing the addition and deletion of the data source of Presto through the implementation of catalogConfig converted from the data in the step 2.3.
Step 2.5: presto integration.
Presto uses jdbc to perform code integration, and Presto uses ANSI _ SQL to query multi-source heterogeneous data in a jdbc mode.
Example 3:
an embodiment 3 of the present disclosure provides a Presto-based cross-library query system, including:
a pre-data source registration module configured to: storing data source information by adopting at least one type of database, and designating a custom table;
a data source registration listening module configured to: monitoring a self-defined table of data source registration in a database by using a CANAL component, and acquiring data source registration information in real time;
a data source registration information conversion module configured to: the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
a dynamic data processing module configured to: dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format;
a cross-repository data query module configured to: presto uses jdbc to perform code integration, and uses ANSI _ SQL to query multi-source heterogeneous data.
The detailed working method of the system is the same as the query method provided in embodiment 2, and is not described here again.
Example 4:
an embodiment 4 of the present disclosure provides a computer-readable storage medium, on which a program is stored, where the program, when executed by a processor, implements steps in a Presto-based cross-library query method, where the steps are:
step 4.1: the prepositive data source is registered.
From the perspective of facilitating service integration, MYSQL is used as data source information registration storage, and a user-defined table is specified, the table structure is detailed in table 1 in embodiment 1, and in cooperation with step 4.3, information of the database is encrypted by using an asymmetric encryption algorithm, so that the security of the database information is ensured, binlog logs of MYSQL are opened, and in cooperation with step 4.2, monitoring of data source registration is achieved.
Step 4.2: and registering and monitoring a data source.
The method is based on a client end of a Presto added with a built-in CANAL, collects the condition of data source registration in real time, transmits the information of addition, deletion or modification of the data source registration table to the Presto through the CANAL and converts the information into catalogConfig format which can be identified by the Presto.
Step 4.3: and converting the data source registration information.
The method reduces CANAL monitoring built in Presto into catalogConfig which can be identified by Presto.
Step 4.4: and dynamically registering data source information.
And (4) modifying the original data source registration method of Presto, and dynamically realizing the addition and deletion of the data source of Presto through the implementation of catalogConfig converted from the data in the step 4.3.
Step 4.5: presto integration.
Presto uses jdbc to perform code integration, and Presto uses ANSI _ SQL to query multi-source heterogeneous data in a jdbc mode.
Example 5:
an embodiment 5 of the present disclosure provides an electronic device, including a memory, a processor, and a program stored on the memory and executable on the processor, where the processor implements steps in a Presto-based cross-library query method when executing the program, where the steps are:
step 5.1: the prepositive data source is registered.
From the perspective of facilitating service integration, MYSQL is used as data source information registration storage, and a user-defined table is specified, the table structure is detailed in table 1 in embodiment 1, and in cooperation with step 5.3, information of the database is encrypted by using an asymmetric encryption algorithm, so that the security of the database information is ensured, binlog logs of MYSQL are opened, and in cooperation with step 5.2, monitoring of data source registration is achieved.
Step 5.2: and registering and monitoring a data source.
The method is based on a client end of a Presto added with a built-in CANAL, collects the condition of data source registration in real time, transmits the information of addition, deletion or modification of the data source registration table to the Presto through the CANAL and converts the information into catalogConfig format which can be identified by the Presto.
Step 5.3: and converting the data source registration information.
The method reduces CANAL monitoring built in Presto into catalogConfig which can be identified by Presto.
Step 5.4: and dynamically registering data source information.
And (3) modifying the original data source registration method of Presto, and dynamically realizing the addition and deletion of the data source of Presto through the implementation of catalogConfig converted from the data in the step 5.3.
Step 5.5: presto integration.
Presto uses jdbc to perform code integration, and Presto uses ANSI _ SQL to query multi-source heterogeneous data in a jdbc mode.
As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure, and various modifications and changes may be made to the present disclosure by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present disclosure should be included in the protection scope of the present disclosure.

Claims (10)

1. A Presto-based dynamic data processing method is characterized by comprising the following steps:
storing data source information by adopting at least one database type, and designating a user-defined table;
monitoring the user-defined table by using a CANAL component, and acquiring data source registration information in real time;
the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
and dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format.
2. The Presto-based dynamic data processing method according to claim 1, characterized in that a MYSQL database is used for data source information storage.
3. The Presto-based dynamic data processing method according to claim 2, characterized in that binlog log of MYSQL is opened to cooperate with the CANAL component to listen to the custom table of data source registration.
4. The Presto-based dynamic data processing method according to claim 1, characterized in that the information of the encryption database using an asymmetric encryption algorithm;
alternatively, the first and second electrodes may be,
adding a client end with a built-in CANAL based on Presto, and collecting data source registration information in real time;
alternatively, the first and second electrodes may be,
and storing data source information by adopting an Oracle database or a Hive database.
5. A cross-library query method based on Presto is characterized by comprising the following steps:
storing data source information by adopting at least one database type, and designating a user-defined table;
monitoring the user-defined table by using a CANAL component, and acquiring data source registration information in real time;
the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format;
presto uses jdbc to perform code integration, and uses ANSI _ SQL to query multi-source heterogeneous data.
6. The Presto-based cross-library query method of claim 5, characterized in that a MYSQL database is used for data source information storage;
and opening a binlog log of MYSQL, and monitoring a self-defined table registered by a data source by matching with a CANAL component.
7. The Presto-based cross-repository query method of claim 5, characterized in that the information of the encrypted database using an asymmetric encryption algorithm;
alternatively, the first and second electrodes may be,
adding a client end with a built-in CANAL based on Presto, and collecting data source registration information in real time;
alternatively, the first and second electrodes may be,
and storing data source information by adopting an Oracle database or a Hive database.
8. A Presto-based cross-repository query system, comprising:
a pre-data source registration module configured to: storing data source information by adopting at least one type of database, and designating a custom table;
a data source registration listening module configured to: monitoring a self-defined table of data source registration in a database by using a CANAL component, and acquiring data source registration information in real time;
a data source registration information conversion module configured to: the information of addition, deletion or modification of the data source registry is transmitted to Presto through CANAL and converted into catalogConfig format which can be identified by Presto;
a dynamic data processing module configured to: dynamically realizing the addition, deletion or modification of the data source of Presto through the obtained data in the catalogConfig format;
a cross-repository data query module configured to: presto uses jdbc to perform code integration, and uses ANSI _ SQL to query multi-source heterogeneous data.
9. A computer-readable storage medium, on which a program is stored, which, when being executed by a processor, carries out the steps of the Presto-based cross-library query method according to claim 7.
10. An electronic device comprising a memory, a processor, and a program stored on the memory and executable on the processor, wherein the processor implements the steps of the Presto-based cross-library query method of claim 7 when executing the program.
CN202011210164.9A 2020-11-03 2020-11-03 Presto-based dynamic data processing method and cross-library query method Active CN112364047B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011210164.9A CN112364047B (en) 2020-11-03 2020-11-03 Presto-based dynamic data processing method and cross-library query method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011210164.9A CN112364047B (en) 2020-11-03 2020-11-03 Presto-based dynamic data processing method and cross-library query method

Publications (2)

Publication Number Publication Date
CN112364047A true CN112364047A (en) 2021-02-12
CN112364047B CN112364047B (en) 2024-04-09

Family

ID=74513640

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011210164.9A Active CN112364047B (en) 2020-11-03 2020-11-03 Presto-based dynamic data processing method and cross-library query method

Country Status (1)

Country Link
CN (1) CN112364047B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563509A (en) * 2018-04-28 2018-09-21 北京京东金融科技控股有限公司 Data query implementation method, device, medium and electronic equipment
CN109815283A (en) * 2018-12-18 2019-05-28 中科曙光南京研究院有限公司 A kind of heterogeneous data source visual inquiry method
CN110555076A (en) * 2019-08-22 2019-12-10 上海数禾信息科技有限公司 Data marking method, processing method and device
CN111078728A (en) * 2019-12-19 2020-04-28 山大地纬软件股份有限公司 Cross-database query method and device in database filing mode
CN111177173A (en) * 2020-01-02 2020-05-19 普元信息技术股份有限公司 System and method for realizing data synchronization optimization processing under big data environment
CN111259036A (en) * 2020-01-10 2020-06-09 苏州达家迎信息技术有限公司 Cross-library and cross-table query method, device, server and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563509A (en) * 2018-04-28 2018-09-21 北京京东金融科技控股有限公司 Data query implementation method, device, medium and electronic equipment
CN109815283A (en) * 2018-12-18 2019-05-28 中科曙光南京研究院有限公司 A kind of heterogeneous data source visual inquiry method
CN110555076A (en) * 2019-08-22 2019-12-10 上海数禾信息科技有限公司 Data marking method, processing method and device
CN111078728A (en) * 2019-12-19 2020-04-28 山大地纬软件股份有限公司 Cross-database query method and device in database filing mode
CN111177173A (en) * 2020-01-02 2020-05-19 普元信息技术股份有限公司 System and method for realizing data synchronization optimization processing under big data environment
CN111259036A (en) * 2020-01-10 2020-06-09 苏州达家迎信息技术有限公司 Cross-library and cross-table query method, device, server and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
子非鱼LEO: "Presto", pages 4 - 8, Retrieved from the Internet <URL:https://blog.csdn.net/Leo1120178518/article/details/107580459> *
梁满;周传生;: "基于Presto海量日志分析系统的设计", 黑龙江科技信息, no. 01 *

Also Published As

Publication number Publication date
CN112364047B (en) 2024-04-09

Similar Documents

Publication Publication Date Title
US20200210423A1 (en) Multi-party data joint query method, device, server and storage medium
CN110750650A (en) Construction method and device of enterprise knowledge graph
CN111478961A (en) Multi-tenant service calling method and device
CN107784026B (en) ETL data processing method and device
CN101853157B (en) Automatic identification method for application software GUI object
TW201814565A (en) Method and device for auditing SQL
JP2006505873A5 (en)
CA2518902A1 (en) System and method for query planning and execution
CN111177244A (en) Data association analysis method for multiple heterogeneous databases
EP3701387A1 (en) System and method for data management
CN115391142A (en) Database audit log generation method and system
CN112487075B (en) Method for integrating relational database data conversion operators and non-relational database data conversion operators
CN112364047A (en) Presto-based dynamic data processing method and cross-library query method
CN111078728B (en) Cross-database query method and device in database archiving mode
CN110990669A (en) DPI (deep packet inspection) analysis method and system based on rule generation
CN115905371A (en) Data trend analysis method, device and equipment and computer readable storage medium
CN102662995B (en) A kind of method that quick position mobile phone application data upgrades
CN106874270B (en) Data consistency authentication method and device
CN111143329B (en) Data processing method and device
CN112765200A (en) Data query method and device based on Elasticissearch
CN110019518B (en) Data processing method and device
CN114201772B (en) Stock data desensitization method and device
KR101439346B1 (en) Complex Event Processing Apparatus for referring tables from an external Database
CN117743375B (en) Multi-scene retrieval generation device and method for power private network communication index
JP2012118609A (en) Sql verification system, method and program thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20220325

Address after: 250013 Shanke Zhongchuang space 203-g, No. 19 Keyuan Road, Lixia District, Jinan City, Shandong Province

Applicant after: Shandong Shanke intellectual property operation center Co.,Ltd.

Address before: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province

Applicant before: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220608

Address after: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province

Applicant after: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD.

Address before: 250013 Shanke Zhongchuang space 203-g, No. 19 Keyuan Road, Lixia District, Jinan City, Shandong Province

Applicant before: Shandong Shanke intellectual property operation center Co.,Ltd.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20221228

Address after: Room 305, Block B, Yinhe Building, No. 2008, Xinluo Street, Jinan Area, China (Shandong) Pilot Free Trade Zone, Jinan, Shandong 250098

Applicant after: Shandong Huazhi Talent Technology Co.,Ltd.

Address before: 250014 3rd floor, block B, Yinhe building, 2008 Xinluo street, high tech Zone, Jinan City, Shandong Province

Applicant before: SHANDONG ECLOUD INFORMATION TECHNOLOGY CO.,LTD.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant