CN116302206A - Presto data source hot loading method based on MQ - Google Patents
Presto data source hot loading method based on MQ Download PDFInfo
- Publication number
- CN116302206A CN116302206A CN202310335125.9A CN202310335125A CN116302206A CN 116302206 A CN116302206 A CN 116302206A CN 202310335125 A CN202310335125 A CN 202310335125A CN 116302206 A CN116302206 A CN 116302206A
- Authority
- CN
- China
- Prior art keywords
- data source
- presto
- redis
- service
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000011068 loading method Methods 0.000 title claims abstract description 38
- 238000000034 method Methods 0.000 claims abstract description 30
- 238000012544 monitoring process Methods 0.000 claims abstract description 5
- 239000003054 catalyst Substances 0.000 claims description 13
- 238000012986 modification Methods 0.000 claims description 10
- 230000004048 modification Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 8
- 238000012217 deletion Methods 0.000 claims description 5
- 230000037430 deletion Effects 0.000 claims description 5
- 238000012423 maintenance Methods 0.000 abstract description 6
- 238000011161 development Methods 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 5
- 238000007792 addition Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of data loading, and provides a presto data source hot loading method based on MQ, which comprises the following steps: constructing a redis client, and initializing presto service through a redis queue; acquiring data source configuration information from a redis by monitoring the redis queue, and identifying a corresponding operation type according to the acquired data source configuration information; calling a corresponding method of the ConnectorManager class file according to the identified operation type to operate the data source; the presto service is deployed, and the operated data sources are verified. The invention can improve the ductility and flexibility of prestoc, reduce delay time, remarkably improve the stability of the data source updating process and system, improve the development and debugging efficiency and save the operation and maintenance cost.
Description
Technical Field
The invention relates to the technical field of data loading, in particular to a presto data source hot loading method based on MQ.
Background
presto is a memory-based open-source distributed query engine which can be connected with various data sources, but modification of the data sources can only be supported under a fixed directory in presto service, the data sources are reloaded by restarting the service, and real-time update of the data sources cannot be achieved. In the actual data source updating, the data sources are newly added, modified or deleted in the presto, which can only be performed under the corresponding directory (/ etc/catalog) of the presto service, and must be named according to the properties file mode, and each change must enter the server and the presto service, thus the operation is complicated. In addition, after the data sources are newly added, modified or deleted, the service must be restarted to be effective, the development and debugging efficiency is low, and the operation and maintenance cost is high. If the data source changes more frequently, the modification costs are very high and may block the use of the caller.
Therefore, how to improve the efficiency of data update in presto and reduce the cost of data update is a technical problem to be solved.
Disclosure of Invention
In view of the above, the present invention aims to overcome the deficiencies of the prior art and provide a pre data source hot loading method based on MQ.
The invention provides a presto data source hot loading method based on MQ, comprising the following steps:
step S1: constructing a redis client, and initializing presto service through a redis queue;
step S2: acquiring data source configuration information from a redis client by monitoring a redis queue, and identifying a corresponding operation type according to the acquired data source configuration information;
step S3: calling a corresponding method of the ConnectorManager class file according to the identified operation type to operate the data source;
step S4: the presto service is deployed, and the operated data sources are verified.
As a preferred aspect of the present invention, step S1 of the pre data source hot loading method based on MQ of the present invention comprises:
step S11: creating a configuration file in a presto service, writing redis configuration information in the created configuration file, adding maven dependence of a redis client in a presto-main module, writing a redis client class, reading the redis configuration information of the written configuration file, and constructing a redis client;
step S12: creating a redis queue, storing the total data source configuration information in the service system in a redis client through the created redis queue, sending the changed data source name in the service system to presto service, and updating the changed data source connection information to the redis client;
step S13: creating a catalogMap in prestoc service, storing the data source loaded by the current prestoc service, initializing prestoc service, acquiring the full data source configuration information from a redis client, and serializing the acquired full data source configuration information;
step S14: and sequentially traversing and reading each data source according to the serialized data source configuration information, loading the read data sources into a presto-server, and simultaneously storing the read data sources in the created catalogMap.
As a preferred embodiment of the present invention, in step S11 of the pre data source hot loading method based on MQ, a configuration file is created inside the pre service, and redis configuration information is written in the created configuration file, which includes: creating a source.properties file under the pre-internal etc/directory, and writing the configuration information of redis in the created source.properties file in a key-value mode.
As a preferred aspect of the present invention, step S3 of the pre data source hot loading method based on MQ of the present invention comprises: and constructing an attribute object of the data source according to the identified operation type, and calling a corresponding method of the connectionmanager class file to operate the data source.
As a preferred aspect of the present invention, step S3 of the pre data source hot loading method based on MQ of the present invention comprises: when the identified operation type is newly added, calling a connector factor file to create a connector object according to connection information, a data source name and data source type information in the data source configuration information, generating a catalyst object according to the created connector object, registering the generated catalyst object to a catalyst manager through the catalyst manager file to finish the addition of the data source, advertising the whole through the Announcer file, and updating a connector id set.
As a preferred aspect of the present invention, step S3 of the pre data source hot loading method based on MQ of the present invention comprises: when the identified operation type is deletion, removing the registered catalogName data source name through a CatalogManager manager, removing metadata, authority control data, index data, schema mode configuration, table configuration and column configuration according to a connector id, advertising the global through an Announcer file, and updating the connector id set.
As a preferred aspect of the present invention, step S3 of the pre data source hot loading method based on MQ of the present invention comprises: when the identified operation type is modification, deleting the data source, and then adding the data source according to the modification requirement.
As a preferred aspect of the present invention, step S3 of the pre data source hot loading method based on MQ of the present invention comprises:
step S31: compiling a presto-main.jar file, and replacing the jar file under the corresponding directory with the compiled presto-main.jar file when presto service is deployed;
step S32: starting prest-server service, sending change information of a data source through a redis queue, and connecting the prest-server service by using a prest-cli client or prest-jdbc in a non-restarting mode;
step S33: and verifying whether the operated data source has been dynamically updated by executing the SQL statement.
Next, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed, performs the MQ-based presto data source hot-loading method described above.
Finally, the invention provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the MQ-based presto data source hot loading method described above when executing the program.
The presto data source hot loading method based on the MQ has the following beneficial effects:
1. the data sources in the presto service comprise addition, deletion and modification updating, the real-time effective updating is realized, the updating is synchronously carried out on each node, the ductility and the flexibility of presto are improved, and the delay time is reduced.
2. And a manual creating of a category configuration file is not needed, so that the stability of the data source updating process and the system is remarkably improved.
3. The presto service is not required to be restarted, so that the development and debugging efficiency can be improved, and the operation and maintenance cost can be saved.
4. When the presto service is abnormally down or upgraded and deployed, the data cannot be lost after the presto service is started, all data sources before the down can be recovered, the operation and maintenance cost is saved, and the working efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a pre data source hot loading method based on MQ according to an exemplary first embodiment of the invention.
FIG. 2 is a flow chart of a pre data source hot loading method based on MQ in accordance with an exemplary second embodiment of the present invention.
FIG. 3 is a flow chart of a pre data source hot loading method based on MQ in accordance with an exemplary fourth embodiment of the present invention.
Fig. 4 is a schematic structural diagram of the apparatus provided by the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It should be noted that, without conflict, the following embodiments and features in the embodiments may be combined with each other; and, based on the embodiments in this disclosure, all other embodiments that may be made by one of ordinary skill in the art without inventive effort are within the scope of the present disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
The terms involved in the following examples are explained as follows:
MQ: the Message Queue is used for Message notification and dynamic monitoring.
presto: the Facebook open-source distributed SQL query engine is used for interactively analyzing the query and cross-library query.
redis: the memory-based non-relational K-V database is mainly used as a database, a cache and a message middleware.
ConnectorManager class files: connector management class + metadata for managing data sources, partitions, indexes, configuration information, etc.
presto-main module: the presto starting module is used for the main program entrance of the server and the program initialization.
maven dependence: the project management tool is an object model for managing projects.
presto-server: presto server for executing cross-library inquiry and analyzing inquiry.
catalogMap: the data source set is identical to the set of all the current data sources.
source. Properties file: and the MQ and other configuration files are used for storing the configuration files and can be read when the device is started.
ConnectorFactory class file: connector factory class files for managing factory classes for all data source connectors.
connector object: connector objects, one category corresponding to one connector object.
Catalog object: a data source, one data source is a catalyst object.
CatalogManager class files: the data source defines a class file and performs a pruned management class on the data source.
Announcer class File: and the notification class is used for discovering the data source and triggering the update of the data source.
presto-cli client: presto client end is in use for connecting presto service, and submitting task.
presto-jdbc: the presto connects url, is used for connecting presto service through JDBC, submit the task.
FIG. 1 is a flow chart of a method for MQ-based prest data source hot loading in accordance with an exemplary first embodiment of the present invention. As shown in fig. 1, the method of the present embodiment is implemented as follows:
step S1: constructing a redis client, and initializing presto service through a redis queue;
step S2: acquiring data source configuration information from a redis client by monitoring a redis queue, and identifying a corresponding operation type according to the acquired data source configuration information;
step S3: calling a corresponding method of the ConnectorManager class file according to the identified operation type to operate the data source;
step S4: the presto service is deployed, and the operated data sources are verified.
The method of the embodiment can realize the update of the data sources including addition, deletion and modification in the prestock service, realize the real-time effectiveness of the update, synchronously update to each node, improve the ductility and flexibility of prestock and reduce the delay time. And a manual creating of a category configuration file is not needed, so that the stability of the data source updating process and the system is remarkably improved.
FIG. 2 is a flow chart of a method for hot loading of an MQ-based prest data source according to a second exemplary embodiment of the present invention, which is a preferred embodiment of the method of FIG. 1, as shown in FIG. 2, the step S1 of the method of the present embodiment is implemented as follows:
step S11: creating a configuration file in a presto service, writing redis configuration information in the created configuration file, adding maven dependence of a redis client in a presto-main module, writing a redis client class, reading the redis configuration information of the written configuration file, and constructing a redis client;
step S12: creating a redis queue, storing the total data source configuration information in the service system in a redis client through the created redis queue, sending the changed data source name in the service system to presto service, and updating the changed data source connection information to the redis client;
step S13: creating a catalogMap in prestoc service, storing the data source loaded by the current prestoc service, initializing prestoc service, acquiring the full data source configuration information from a redis client, and serializing the acquired full data source configuration information;
step S14: and sequentially traversing and reading each data source according to the serialized data source configuration information, loading the read data sources into a presto-server, and simultaneously storing the read data sources in the created catalogMap.
In practical application, in step S11 of the method of the present embodiment, a configuration file is created inside the presto service, and redis configuration information is written in the created configuration file, which is implemented in the following manner: creating a source.properties file under the pre-internal etc/directory, and writing the configuration information of redis in the created source.properties file in a key-value mode.
An exemplary third embodiment of the present invention provides a pre data source hot loading method based on MQ, which is a preferred embodiment of the method shown in fig. 1, and step S3 of the method of the present embodiment includes: and constructing an attribute object of the data source according to the identified operation type, and calling a corresponding method of the connectionmanager class file to operate the data source.
In practical application, step S3 of the method of the present embodiment is implemented as follows:
when the identified operation type is newly added, calling a connector factor file to create a connector object according to connection information, a data source name and data source type information in the data source configuration information, generating a catalyst object according to the created connector object, registering the generated catalyst object to a catalyst manager through the catalyst manager file to finish the addition of the data source, advertising the whole through the Announcer file, and updating a connector id set.
When the identified operation type is deletion, removing the registered catalogName data source name through a CatalogManager manager, removing metadata, authority control data, index data, schema mode configuration, table configuration and column configuration according to a connector id, advertising the global through an Announcer file, and updating the connector id set.
When the identified operation type is modification, deleting the data source, and then adding the data source according to the modification requirement.
FIG. 3 is a flowchart of a pre data source hot loading method based on MQ according to a fourth embodiment of the present invention, as shown in FIG. 3, and step S3 of the method of the present embodiment is implemented as follows:
step S31: compiling a presto-main.jar file, and replacing the jar file under the corresponding directory with the compiled presto-main.jar file when presto service is deployed;
step S32: starting prest-server service, sending change information of a data source through a redis queue, and connecting the prest-server service by using a prest-cli client or prest-jdbc in a non-restarting mode;
step S33: and verifying whether the operated data source has been dynamically updated by executing the SQL statement.
The method of the embodiment does not need to restart presto service, can improve development and debugging efficiency and saves operation and maintenance cost. When the presto service is abnormally down or upgraded and deployed, the data cannot be lost after the presto service is started, all data sources before the down can be recovered, the operation and maintenance cost is saved, and the working efficiency is improved.
The present invention provides a computer readable storage medium having stored thereon a computer program which, when executed, performs the MQ-based presto data source hot-loading method of the present invention described above.
As shown in fig. 4, the present invention also provides an apparatus comprising a processor 110, a communication interface 120, a memory 130 for storing a processor executable computer program, and a communication bus 140. The processor 110, the communication interface 120, and the memory 130 perform communication with each other through the communication bus 140. Processor 110 implements the MQ-based presto data source hot-loading method described above by running an executable computer program.
Wherein the computer program in the memory 130 may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a separate product. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The system embodiments described above are merely illustrative, in which elements illustrated as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected based on actual needs to achieve the purpose of the embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on such understanding, the foregoing technical solutions may be embodied essentially or in part in the form of a software product, which may be stored in a computer-readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the various embodiments or methods of some parts of the embodiments.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the scope of the present invention should be included in the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (10)
1. A method for hot loading of a presto data source based on MQ, the method comprising:
step S1: constructing a redis client, and initializing presto service through a redis queue;
step S2: acquiring data source configuration information from a redis client by monitoring a redis queue, and identifying a corresponding operation type according to the acquired data source configuration information;
step S3: calling a corresponding method of the ConnectorManager class file according to the identified operation type to operate the data source;
step S4: the presto service is deployed, and the operated data sources are verified.
2. The MQ-based prest data source hot-loading method of claim 1, wherein step S1 comprises:
step S11: creating a configuration file in a presto service, writing redis configuration information in the created configuration file, adding maven dependence of a redis client in a presto-main module, writing a redis client class, reading the redis configuration information of the written configuration file, and constructing a redis client;
step S12: creating a redis queue, storing the total data source configuration information in the service system in a redis client through the created redis queue, sending the changed data source name in the service system to presto service, and updating the changed data source connection information to the redis client;
step S13: creating a catalogMap in prestoc service, storing the data source loaded by the current prestoc service, initializing prestoc service, acquiring the full data source configuration information from a redis client, and serializing the acquired full data source configuration information;
step S14: and sequentially traversing and reading each data source according to the serialized data source configuration information, loading the read data sources into a presto-server, and simultaneously storing the read data sources in the created catalogMap.
3. The MQ-based prest data source hot-loading method according to claim 2, wherein creating a configuration file inside the prest service and writing redis configuration information in the created configuration file in step S11 comprises: creating a source.properties file under the pre-internal etc/directory, and writing the configuration information of redis in the created source.properties file in a key-value mode.
4. The MQ-based prest data source hot-loading method of claim 1, wherein step S3 comprises: and constructing an attribute object of the data source according to the identified operation type, and calling a corresponding method of the connectionmanager class file to operate the data source.
5. The MQ-based prest data source hot-loading method of claim 1, wherein step S3 comprises: when the identified operation type is newly added, calling a connector factor file to create a connector object according to connection information, a data source name and data source type information in the data source configuration information, generating a catalyst object according to the created connector object, registering the generated catalyst object to a catalyst manager through the catalyst manager file to finish the addition of the data source, advertising the whole through the Announcer file, and updating a connector id set.
6. The MQ-based prest data source hot-loading method of claim 1, wherein step S3 comprises: when the identified operation type is deletion, removing the registered catalogName data source name through a CatalogManager manager, removing metadata, authority control data, index data, schema mode configuration, table configuration and column configuration according to a connector id, advertising the global through an Announcer file, and updating the connector id set.
7. The MQ-based prest data source hot-loading method of claim 1, wherein step S3 comprises: when the identified operation type is modification, deleting the data source, and then adding the data source according to the modification requirement.
8. The MQ-based prest data source hot-loading method of claim 1, wherein step S3 comprises:
step S31: compiling a presto-main.jar file, and replacing the jar file under the corresponding directory with the compiled presto-main.jar file when presto service is deployed;
step S32: starting prest-server service, sending change information of a data source through a redis queue, and connecting the prest-server service by using a prest-cli client or prest-jdbc in a non-restarting mode;
step S33: and verifying whether the operated data source has been dynamically updated by executing the SQL statement.
9. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed, performs the method according to any of claims 1-8.
10. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method according to any one of claims 1-8 when the program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310335125.9A CN116302206B (en) | 2023-03-31 | 2023-03-31 | Presto data source hot loading method based on MQ |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310335125.9A CN116302206B (en) | 2023-03-31 | 2023-03-31 | Presto data source hot loading method based on MQ |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116302206A true CN116302206A (en) | 2023-06-23 |
| CN116302206B CN116302206B (en) | 2024-03-12 |
Family
ID=86777935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310335125.9A Active CN116302206B (en) | 2023-03-31 | 2023-03-31 | Presto data source hot loading method based on MQ |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116302206B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815283A (en) * | 2018-12-18 | 2019-05-28 | 中科曙光南京研究院有限公司 | A kind of heterogeneous data source visual inquiry method |
| CN111858652A (en) * | 2020-07-07 | 2020-10-30 | 合肥森亿智能科技有限公司 | Cross-data-source query method and system based on message queue and server node |
| CN114780165A (en) * | 2022-03-14 | 2022-07-22 | 中国人寿保险股份有限公司 | Application service configuration hot loading method based on message queue and related equipment |
| CN115017182A (en) * | 2022-06-29 | 2022-09-06 | 京东方科技集团股份有限公司 | Visual data analysis method and equipment |
-
2023
- 2023-03-31 CN CN202310335125.9A patent/CN116302206B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815283A (en) * | 2018-12-18 | 2019-05-28 | 中科曙光南京研究院有限公司 | A kind of heterogeneous data source visual inquiry method |
| CN111858652A (en) * | 2020-07-07 | 2020-10-30 | 合肥森亿智能科技有限公司 | Cross-data-source query method and system based on message queue and server node |
| CN114780165A (en) * | 2022-03-14 | 2022-07-22 | 中国人寿保险股份有限公司 | Application service configuration hot loading method based on message queue and related equipment |
| CN115017182A (en) * | 2022-06-29 | 2022-09-06 | 京东方科技集团股份有限公司 | Visual data analysis method and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116302206B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20120158795A1 (en) | Entity triggers for materialized view maintenance | |
| CN111522631B (en) | Distributed transaction processing method, device, server and medium | |
| CN110795455A (en) | Dependency relationship analysis method, electronic device, computer device and readable storage medium | |
| CN101046821A (en) | Generic database manipulator | |
| US20150317331A1 (en) | Unified platform for application development | |
| CN111737227B (en) | Data modification method and system | |
| CN104572920A (en) | Data arrangement method and data arrangement device | |
| CN104679500B (en) | Method and device for realizing automatic generation of entity class | |
| CN110134681B (en) | Data storage and query method and device, computer equipment and storage medium | |
| CN115145943B (en) | Method, system, equipment and storage medium for rapidly comparing metadata of multiple data sources | |
| US11567957B2 (en) | Incremental addition of data to partitions in database tables | |
| CN112395307A (en) | Statement execution method, statement execution device, server and storage medium | |
| CN111611276A (en) | Data query method, device and storage medium | |
| CN111694853B (en) | Data increment collection method and device based on lineage, storage medium and electronic equipment | |
| CN116302206B (en) | Presto data source hot loading method based on MQ | |
| CN111753141B (en) | Data management method and related equipment | |
| CN110737506A (en) | virtual machine image version management method | |
| CN110543465A (en) | directory operation method and device, computer equipment and storage medium | |
| CN115203260A (en) | Abnormal data determination method and device, electronic equipment and storage medium | |
| CN114819631A (en) | Multitask visualization method and device, computer equipment and storage medium | |
| CN112817931B (en) | Incremental version file generation method and device | |
| CN103677949A (en) | Method and device for caching entity with variable unique value | |
| CN105630889A (en) | Method and device for realizing generic cache | |
| CN112181921A (en) | Data processing method and device | |
| CN112685431B (en) | Asynchronous caching method, device, system, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 430058 No. n3013, 3rd floor, R & D building, building n, Artificial Intelligence Science Park, economic and Technological Development Zone, Caidian District, Wuhan City, Hubei Province Applicant after: Zhongdian Cloud Computing Technology Co.,Ltd. Address before: 430058 No. n3013, 3rd floor, R & D building, building n, Artificial Intelligence Science Park, economic and Technological Development Zone, Caidian District, Wuhan City, Hubei Province Applicant before: CLP cloud Digital Intelligence Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |