CN110554993B - Data query method and system - Google Patents

Data query method and system Download PDF

Info

Publication number
CN110554993B
CN110554993B CN201910846539.1A CN201910846539A CN110554993B CN 110554993 B CN110554993 B CN 110554993B CN 201910846539 A CN201910846539 A CN 201910846539A CN 110554993 B CN110554993 B CN 110554993B
Authority
CN
China
Prior art keywords
database
query
file
unit
remote
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910846539.1A
Other languages
Chinese (zh)
Other versions
CN110554993A (en
Inventor
李杨
袁甲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN201910846539.1A priority Critical patent/CN110554993B/en
Publication of CN110554993A publication Critical patent/CN110554993A/en
Application granted granted Critical
Publication of CN110554993B publication Critical patent/CN110554993B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/156Query results presentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data query method and a data query system. The data query method comprises the following steps: receiving a query request from a client; the query request includes: query identification, query statement and query condition; acquiring a remote file path from a registry according to the query identifier; downloading the database file according to the remote file path; loading a preset H2 database with a database file to generate an H2 database connection string; executing the query statement and the query condition according to the H2 database connection string to obtain a query result; and sending the query result to the client. The invention can reduce the cost, reduce the dependence, facilitate the maintenance and comprehensively improve the data inflow and outflow efficiency.

Description

Data query method and system
Technical Field
The invention relates to the field of data query, in particular to a data query method and a data query system.
Background
At present, in the market, data persistence and query modes mainly include several modes of database storage and deployment in a big data framework of a distributed file system. According to different industry specifications, service scales, service requirements and implementation cost, developers select different persistence processing modes.
The database is used for persistence, the main relational databases in the market are ORACLE and MYSQL, and the low-cost MYSQL is the preferred database of most companies. However, MYSQL has a problem that when the data volume of tens of millions of entries or even hundreds of millions of entries is processed in batches, the performance of the import and export operation and the query operation is greatly reduced. Although performance optimization can be performed by smart data structure design and adopting ways such as table partitioning, library partitioning and the like. However, under the conditions that the data volume is increased quickly, the granularity of the partition library is difficult to ensure to be small enough, and the partition is increased frequently, the maintenance cost of the data partition and the MYSQL performance still have certain bottlenecks.
The data persistence is carried out by using a big data platform, which is a relatively universal scheme. However, the current business data volume still does not meet the standard of big data, and meanwhile, the use of a big data platform still requires personnel with related experience to develop and maintain.
Disclosure of Invention
The embodiment of the invention mainly aims to provide a data query method and a data query system, so that an embedded database based on H2 is introduced for data query processing, the cost is reduced, the dependence is reduced, the maintenance is convenient, and the data inflow and outflow efficiency can be comprehensively improved.
In order to achieve the above object, an embodiment of the present invention provides a data query method, including:
receiving a query request from a client; the query request includes: query identification, query statement and query condition;
acquiring a remote file path from a registry according to the query identifier;
downloading the database file according to the remote file path;
loading a preset H2 database with a database file to generate an H2 database connection string;
executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
and sending the query result to the client.
An embodiment of the present invention further provides a data query system, including:
the receiving unit is used for receiving a query request from a client; the query request includes: query identification, query statement and query condition;
the remote file path unit is used for acquiring a remote file path from the registry according to the query identifier;
the downloading unit is used for downloading the database file according to the remote file path;
the database connection string unit is used for loading a preset H2 database with database files and generating an H2 database connection string;
the query result unit is used for executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
and the sending unit is used for sending the query result to the client.
The embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor implements the steps of the data query method when executing the computer program.
The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the data query method are implemented.
According to the data query method and system, the remote file path is obtained from the registry according to the query identifier, the database file is downloaded according to the remote file path, the preset H2 database is loaded with the database file to generate the H2 database connection string, the query statement and the query condition are executed according to the H2 database connection string to obtain the query result, and finally the query result is sent to the client.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a flow chart of a data query method according to a first embodiment of the present invention;
FIG. 2 is a flow chart of a data query method according to a second embodiment of the present invention;
fig. 3 is a block diagram of a data query system in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
In view of the fact that the import performance and the query performance of a persistence scheme based on MYSQL are reduced, partition implementation difficulty is increased, and maintenance cost is increased in the prior art, embodiments of the present invention provide a data query method to introduce an H2-based embedded database for data query processing, so that cost is reduced, dependence is reduced, maintenance is facilitated, and data inflow and outflow efficiency can be comprehensively improved. The present invention will be described in detail below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a data query method according to a first embodiment of the present invention. As shown in fig. 1, the data query method includes:
s101: receiving a query request from a client; the query request includes: a query identification, a query statement, and a query condition.
S102: and acquiring a remote file path from the registry according to the query identifier.
S103: and downloading the database file according to the remote file path.
Db, and downloading the database file to the local node according to the remote file path.
S104: and loading the preset H2 database with the database file to generate an H2 database connection string.
S105: and executing the query statement and the query condition according to the H2 database connection string to obtain a query result.
S106: and sending the query result to the client.
The execution subject of the data query method shown in fig. 1 may be a computer. As can be seen from the process shown in fig. 1, the data query method according to the embodiment of the present invention first obtains a remote file path from the registry according to the query identifier, then downloads the database file according to the remote file path, then loads the database file into the preset H2 database, generates an H2 database connection string, then executes the query statement and the query condition according to the H2 database connection string, obtains the query result, and finally sends the query result to the client.
The storage pressure of the conventional MYSQL is concentrated on a database server, and the data storage pressure and the data operation pressure can be separated, so that the system is more convenient to maintain and the node cost is reduced. The invention can also increase the time for inquiring 2 ten thousand data in 4400 ten thousand data from about 500ms to about 300ms, thereby meeting the existing inquiry requirement.
Fig. 2 is a flowchart of a data query method according to a second embodiment of the present invention. As shown in fig. 2, before executing S101, a data import operation may also be performed, including:
s201: a query identification and an original text file path are received.
S202: and downloading the original text file according to the original text file path.
The original text file can be downloaded to the local node according to the original text file path.
S203: and converting the original text file into a separator text file according to a preset configuration file.
An ETL (Extract-Transform-Load) conversion operation may be performed according to a preset configuration file to convert the original text file into a separator text file.
S204: an initial database file is generated from the separator text file.
Among them, the H2 DataBase may be used to generate an initial DataBase file with a suffix of.mv.db in a Java DataBase Connectivity (JDBC) manner.
S205: the table building statements and the indexing statements are executed in the initial database file according to the configuration file to generate a table.
S206: the delimiter text file is read, and the delimiter text file is inserted into the table in the Java database connection manner of the H2 database, thereby generating a database file.
In a specific implementation, the separator text file can be read in a stream form, and inserted into a table in a Java database connection manner of the H2 database, so as to generate a database file with a suffix of.mv.db.
S207: and uploading the database file according to a preset remote file path.
S208: and binding the query identifier and the remote file path, and storing the query identifier and the remote file path in a registry.
Wherein the registry is located in MYSQL.
Therefore, the invention can flexibly divide the data set according to the desired dimension when importing a large amount of data, and perform fine-grained database division. Compared with the existing MYSQL import operation, the method can shorten the time for importing 4400 ten thousand pieces of data from 30 minutes to less than 8 minutes in the same network environment, and greatly improves the import efficiency of the persistent data.
In one embodiment, the method further comprises: and caching the database file. After executing S102, the method further includes: judging whether the database file is cached or not; and when the database file is cached, acquiring the H2 database connection string according to the remote file path. When the database file is not cached, S103 is executed and a caching operation is performed.
In one embodiment, caching the database file comprises: downloading the database file according to a preset cache policy and a remote file path in a registry, wherein the cache policy can be: caching the database file on the same day; loading a preset H2 database with a database file to generate an H2 database connection string; the remote file path and H2 database connection string are stored in the form of key-value pairs. Where the key may be a remote file path and the value may be H2 database connection string.
Meanwhile, a sub-thread can be started, and the cache is emptied at regular time according to a certain deletion strategy, for example, the cache of the database file in the previous day is emptied.
The specific process of the embodiment of the invention is as follows:
1. and receiving the query identifier and the original text file path, and downloading the original text file to the local node according to the original text file path.
2. And carrying out ETL conversion operation according to a preset configuration file, and converting the original text file into a separator text file.
3. And generating an initial database file with the suffix of mv.db by using an H2 database in a Java database connection mode.
4. The table building statements and the indexing statements are executed in the initial database file according to the configuration file to generate a table.
5. The separator text file is read in stream form and inserted into the table in the Java database connection of the H2 database, generating a database file with the suffix of.mv.db.
6. Uploading a database file according to a preset remote file path; and binding the query identifier and the remote file path, and storing the query identifier and the remote file path into a registry located in MYSQL.
7. Receiving a query request from a client; the query request includes: a query identification, a query statement, and a query condition.
8. And acquiring a remote file path from the registry according to the query identifier.
9. And judging whether the database file is cached or not. And when the database file is not cached, downloading the database file according to the remote file path, and caching the database file.
10. And loading a preset H2 database into the database file to generate an H2 database connection string.
11. And executing the query statement and the query condition according to the H2 database connection string to obtain a query result, and sending the query result to the client.
To sum up, the data query method according to the embodiment of the present invention obtains a remote file path from a registry according to a query identifier, downloads a database file according to the remote file path, loads a preset H2 database with the database file, generates an H2 database connection string, executes a query statement and a query condition according to the H2 database connection string, obtains a query result, and finally sends the query result to a client.
Based on the same inventive concept, the embodiment of the invention also provides a data query system, and as the principle of solving the problems of the system is similar to the data query method, the implementation of the system can refer to the implementation of the method, and repeated parts are not described again.
Fig. 3 is a block diagram of a data query system in the embodiment of the present invention. As shown in fig. 3, the data query system includes:
the receiving unit is used for receiving a query request from a client; the query request includes: query identification, query statement and query condition;
the remote file path unit is used for acquiring a remote file path from the registry according to the query identifier;
the downloading unit is used for downloading the database file according to the remote file path;
the database connection string unit is used for loading a preset H2 database with database files and generating an H2 database connection string;
the query result unit is used for executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
and the sending unit is used for sending the query result to the client.
In one embodiment, the receiving unit is further configured to: receiving a query identifier and an original text file path;
the download unit is further configured to: downloading an original text file according to the original text file path;
the data query system further comprises:
the conversion unit is used for converting the original text file into a separator text file according to a preset configuration file;
the initial database file unit is used for generating an initial database file according to the separator text file;
the table unit is used for executing the table building statement and the index building statement in the initial database file according to the configuration file to generate a table;
a database file unit for reading the separator text file, inserting the separator text file into the table in the Java database connection mode of H2 database, and generating a database file;
the uploading unit is used for uploading the database file according to a preset remote file path;
and the binding unit is used for binding the query identifier and the remote file path and storing the query identifier and the remote file path into the registry.
In one embodiment, the method further comprises the following steps:
the cache unit is used for caching the database file;
the judging unit is used for judging whether the database file is cached or not;
and the acquisition unit is used for acquiring the H2 database connection string according to the remote file path when the database file is cached.
In one embodiment, the cache unit is specifically configured to:
downloading the database file according to a preset caching strategy and a remote file path in a registry;
loading a preset H2 database with a database file to generate an H2 database connection string;
the remote file path and H2 database connection string are stored in the form of key-value pairs.
To sum up, the data query system of the embodiment of the present invention obtains a remote file path from the registry according to the query identifier, downloads the database file according to the remote file path, loads the database file into the preset H2 database, generates the H2 database connection string, executes the query statement and the query condition according to the H2 database connection string, obtains the query result, and finally sends the query result to the client.
An embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor may implement all or part of contents of the data query method when executing the computer program, for example, the processor may implement the following contents when executing the computer program:
receiving a query request from a client; the query request includes: query identification, query statement and query condition;
acquiring a remote file path from a registry according to the query identifier;
downloading the database file according to the remote file path;
loading a preset H2 database with a database file to generate an H2 database connection string;
executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
and sending the query result to the client.
To sum up, the computer device of the embodiment of the present invention obtains a remote file path from the registry according to the query identifier, downloads the database file according to the remote file path, loads the database file into the preset H2 database, generates an H2 database connection string, executes the query statement and the query condition according to the H2 database connection string, obtains the query result, and finally sends the query result to the client.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, may implement all or part of the contents of the data query method, for example, when the processor executes the computer program, the following contents may be implemented:
receiving a query request from a client; the query request includes: query identification, query statement and query condition;
acquiring a remote file path from a registry according to the query identifier;
downloading the database file according to the remote file path;
loading a preset H2 database with a database file to generate an H2 database connection string;
executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
and sending the query result to the client.
To sum up, the computer-readable storage medium of the embodiment of the present invention obtains a remote file path from a registry according to a query identifier, downloads a database file according to the remote file path, loads a preset H2 database with the database file, generates an H2 database connection string, executes a query statement and a query condition according to the H2 database connection string, obtains a query result, and finally sends the query result to a client.
The above-mentioned embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, and it should be understood that the above-mentioned embodiments are only examples of the present invention and should not be used to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (8)

1. A method for querying data, comprising:
receiving a query request from a client; the query request includes: query identification, query statement and query condition;
acquiring a remote file path from a registry according to the query identifier;
downloading a database file according to the remote file path;
loading a preset H2 database with the database file to generate an H2 database connection string;
executing the query statement and the query condition according to the H2 database connection string to obtain a query result;
sending the query result to the client;
the data query method further comprises the following steps: receiving a query identifier and an original text file path;
downloading an original text file according to the original text file path;
converting the original text file into a separator text file according to a preset configuration file;
generating an initial database file according to the separator text file;
executing a table building statement and an index building statement in the initial database file according to the configuration file to generate a table;
reading the separator text file, and inserting the separator text file into the table in a Java database connection mode of the H2 database to generate a database file;
uploading the database file according to a preset remote file path;
and binding the query identifier and the remote file path, and storing the query identifier and the remote file path in the registry.
2. The data query method of claim 1, further comprising: caching the database file;
after obtaining the remote file path from the registry according to the query identifier, the method further comprises:
judging whether the database file is cached or not;
and when the database file is cached, acquiring the H2 database connection string according to the remote file path.
3. The data query method of claim 2, wherein caching the database file comprises:
downloading the database file according to a preset caching strategy and a remote file path in the registry;
loading a preset H2 database with the database file to generate an H2 database connection string;
storing the remote file path and the H2 database connection string in the form of key-value pairs.
4. A data query system, comprising:
the receiving unit is used for receiving a query request from a client; the query request includes: query identification, query statement and query condition;
the remote file path unit is used for acquiring a remote file path from a registry according to the query identifier;
the downloading unit is used for downloading the database file according to the remote file path;
the database connection string unit is used for loading the database file into a preset H2 database to generate an H2 database connection string;
a query result unit, configured to execute the query statement and the query condition according to the H2 database connection string, to obtain a query result;
the sending unit is used for sending the query result to the client;
the receiving unit is further configured to: receiving a query identifier and an original text file path;
the download unit is further configured to: downloading an original text file according to the original text file path;
the data query system further comprises:
the conversion unit is used for converting the original text file into a separator text file according to a preset configuration file;
the initial database file unit is used for generating an initial database file according to the separator text file;
the table unit is used for executing a table building statement and an index building statement in the initial database file according to the configuration file to generate a table;
a database file unit, configured to read the separator text file, insert the separator text file into the table in a Java database connection manner of the H2 database, and generate a database file;
the uploading unit is used for uploading the database file according to a preset remote file path;
and the binding unit is used for binding the query identifier and the remote file path and storing the query identifier and the remote file path into the registry.
5. The data query system of claim 4, further comprising:
the cache unit is used for caching the database file;
the judging unit is used for judging whether the database file is cached or not;
and the obtaining unit is used for obtaining the H2 database connection string according to the remote file path when the database file is cached.
6. The data query system of claim 5, wherein the cache unit is specifically configured to:
downloading the database file according to a preset caching strategy and a remote file path in the registry;
loading a preset H2 database with the database file to generate an H2 database connection string;
storing the remote file path and the H2 database connection string in the form of a key-value pair.
7. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the data query method according to any one of claims 1 to 3 when executing the computer program.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the data query method of any one of claims 1 to 3.
CN201910846539.1A 2019-09-09 2019-09-09 Data query method and system Active CN110554993B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910846539.1A CN110554993B (en) 2019-09-09 2019-09-09 Data query method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910846539.1A CN110554993B (en) 2019-09-09 2019-09-09 Data query method and system

Publications (2)

Publication Number Publication Date
CN110554993A CN110554993A (en) 2019-12-10
CN110554993B true CN110554993B (en) 2022-05-17

Family

ID=68739476

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910846539.1A Active CN110554993B (en) 2019-09-09 2019-09-09 Data query method and system

Country Status (1)

Country Link
CN (1) CN110554993B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101937474A (en) * 2010-10-14 2011-01-05 广州从兴电子开发有限公司 Mass data query method and device
CN105450703A (en) * 2014-08-28 2016-03-30 杭州迪普科技有限公司 Data caching method and data caching device
CN110134705A (en) * 2018-02-09 2019-08-16 中国移动通信集团有限公司 A kind of data query method, cache server and terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101937474A (en) * 2010-10-14 2011-01-05 广州从兴电子开发有限公司 Mass data query method and device
CN105450703A (en) * 2014-08-28 2016-03-30 杭州迪普科技有限公司 Data caching method and data caching device
CN110134705A (en) * 2018-02-09 2019-08-16 中国移动通信集团有限公司 A kind of data query method, cache server and terminal

Also Published As

Publication number Publication date
CN110554993A (en) 2019-12-10

Similar Documents

Publication Publication Date Title
CN109391664B (en) System and method for multi-cluster container deployment
CN105049287A (en) Log processing method and log processing devices
US11481440B2 (en) System and method for processing metadata to determine an object sequence
IL234244A (en) Application installation
CN111241177B (en) Data acquisition method, system and network equipment
CN107480205B (en) Method and device for partitioning data
CN110932912A (en) Method for realizing unified management of configuration files under micro-service architecture
CN111858760B (en) Data processing method and device for heterogeneous database
CN111240892A (en) Data backup method and device
CN106790489B (en) Parallel data loading method and system
Almansouri et al. Hadoop distributed file system for big data analysis
US20150234853A1 (en) Methods Circuits Apparatuses Systems and Associated Computer Executable Code for Data Deduplication
CN105843809B (en) Data processing method and device
CN110554993B (en) Data query method and system
US20190147047A1 (en) Object-level image query and retrieval
CN113077260A (en) Data access method and device based on block chain and electronic equipment
AU2020274505A1 (en) Blockchain cache system
CN111159142B (en) Data processing method and device
CN116775712A (en) Method, device, electronic equipment, distributed system and storage medium for inquiring linked list
CN112100168A (en) Method and device for determining data association relationship
CN115658768A (en) Attribute query method and device for state database and related medium
CN106934044B (en) Data processing method and device
CN115729590A (en) Service deployment method, device, equipment and computer readable storage medium
CN110222105B (en) Data summarization processing method and device
CN108196979B (en) Data backup method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant