CN110888840A - File query method, device, equipment and medium in distributed file system - Google Patents

File query method, device, equipment and medium in distributed file system Download PDF

Info

Publication number
CN110888840A
CN110888840A CN201911082296.5A CN201911082296A CN110888840A CN 110888840 A CN110888840 A CN 110888840A CN 201911082296 A CN201911082296 A CN 201911082296A CN 110888840 A CN110888840 A CN 110888840A
Authority
CN
China
Prior art keywords
query
filtering
file
target directory
metadata server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911082296.5A
Other languages
Chinese (zh)
Inventor
解志阳
张立强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Electronic Information Industry Co Ltd
Original Assignee
Inspur Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Electronic Information Industry Co Ltd filed Critical Inspur Electronic Information Industry Co Ltd
Priority to CN201911082296.5A priority Critical patent/CN110888840A/en
Publication of CN110888840A publication Critical patent/CN110888840A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/144Query formulation

Abstract

The application discloses a file query method, a file query device, electronic equipment and a computer readable storage medium in a distributed file system, wherein the file query method is applied to a client and comprises the following steps: receiving an input filtering query instruction with a preset format; determining a target directory and query parameters by analyzing and filtering the query instruction; generating a filtering query request message carrying a target directory and query parameters; sending the filtering query request message to a metadata server; and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server. The method and the device have the advantages that a new instruction format and a related instruction analysis and processing flow are set, on one hand, the layer-by-layer calling of a system when the request is sent is omitted, on the other hand, filtering query is directly carried out by the metadata server, the file query processing process is effectively simplified, and the file query efficiency is improved.

Description

File query method, device, equipment and medium in distributed file system
Technical Field
The present application relates to the field of distributed system technologies, and in particular, to a method and an apparatus for querying a file in a distributed file system, an electronic device, and a computer-readable storage medium.
Background
Distributed file systems are widely used today in many government and enterprise sectors. In a distributed file system, important file information is stored in a Metadata Server (Metadata Server). In the prior art, when a user or an administrator needs to query some files through a client, generally using an ls command of a Linux system, under a communication mechanism corresponding to the ls command, after layer-by-layer calling of an operating system, a file system, a Lib library and the like, the client can request a metadata server in a distributed system to query the files, and the response is slow; then, the metadata server sends all file information to the client, and the client performs screening query. Since all the file information is transmitted by communication, it takes a lot of time. Moreover, since the linux command itself has a weak filtering function, and only some simple wildcards (such as.
In view of the above, it is an important need for those skilled in the art to provide a solution to the above technical problems.
Disclosure of Invention
The present application aims to provide a file query method, device, electronic device and computer readable storage medium in a distributed file system, so as to effectively simplify the file query process, reduce time consumption and improve efficiency.
In order to solve the above technical problem, in a first aspect, the present application discloses a file query method in a distributed file system, which is applied to a client, and includes:
receiving an input filtering query instruction with a preset format;
determining a target directory and query parameters by analyzing the filtering query instruction;
generating a filtering query request message carrying the target directory and the query parameters;
sending the filtering query request message to a metadata server;
and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server.
Optionally, the sending the filtering query request packet to a metadata server includes:
calling a preset interface to send the filtering query request message to the metadata server; the preset format corresponds to the preset interface.
Optionally, the preset interface includes a getfattr interface or a cephadaemon interface.
Optionally, the determining a target directory and query parameters by parsing the filtering query instruction includes:
and determining each directory fragment and the query parameter of the target directory by analyzing the filtering query instruction.
The application also discloses another file query method in the distributed file system, which is applied to a metadata server and comprises the following steps:
after a client analyzes an input filtering query instruction with a preset format to determine a target directory and query parameters, receiving a filtering query request message which is generated and sent by the client and carries the target directory and the query parameters;
executing a filtering query in the target directory according to the query parameters;
and returning the inquired target file data to the client.
Optionally, the query parameter includes a preset offset; the executing a filtering query in the target directory according to the query parameters includes:
and executing filtering query by taking the file with the ranking larger than the preset offset in the target directory as a query object.
In a second aspect, the present application further discloses a file querying device in a distributed file system, which is applied to a client, and includes:
the instruction processing module is used for receiving an input filtering query instruction in a preset format and determining a target directory and query parameters by analyzing the filtering query instruction;
a message generating module, configured to generate a filtering query request message carrying the target directory and the query parameter;
the message sending module is used for sending the filtering query request message to a metadata server;
and the data acquisition module is used for receiving the target file data returned by the metadata server after the metadata server executes filtering query in the target directory according to the query parameters.
The application also discloses another file query device in a distributed file system, which is applied to a metadata server and comprises:
the message receiving module is used for analyzing an input filtering query instruction with a preset format at a client to determine a target directory and a query parameter, and then receiving a filtering query request message which is generated and sent by the client and carries the target directory and the query parameter;
the filtering query module is used for executing filtering query in the target directory according to the query parameters;
and the data sending module is used for returning the inquired target file data to the client.
In a third aspect, the present application also discloses an electronic device, including:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the file query method in any one of the distributed file systems as described above.
In a fourth aspect, the present application further discloses a computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, is adapted to carry out the steps of the file querying method in any one of the distributed file systems as described above.
The file query method in the distributed file system provided by the application is applied to a client, and comprises the following steps: receiving an input filtering query instruction with a preset format; determining a target directory and query parameters by analyzing the filtering query instruction; generating a filtering query request message carrying the target directory and the query parameters; sending the filtering query request message to a metadata server; and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server.
Therefore, the method and the device have the advantages that a new instruction format and related instruction analysis and processing flows are set, on one hand, layer-by-layer calling of a system is omitted, and the process of sending a request to a metadata server by a client is simplified and accelerated; on the other hand, the metadata server filters and queries the local distributed file data and returns only the filtered and queried target file data to the client, and compared with the large amount of all distributed file data, the time consumption of the transmission process of the target file data is small, and the file query efficiency is further effectively improved. The file query device, the electronic device and the computer-readable storage medium in the distributed file system provided by the application also have the beneficial effects.
Drawings
In order to more clearly illustrate the technical solutions in the prior art and the embodiments of the present application, the drawings that are needed to be used in the description of the prior art and the embodiments of the present application will be briefly described below. Of course, the following description of the drawings related to the embodiments of the present application is only a part of the embodiments of the present application, and it will be obvious to those skilled in the art that other drawings can be obtained from the provided drawings without any creative effort, and the obtained other drawings also belong to the protection scope of the present application.
Fig. 1 is a flowchart of a file query method in a distributed file system according to an embodiment of the present application;
FIG. 2 is a flowchart of a file query method in another distributed file system disclosed in the embodiments of the present application;
fig. 3 is a block diagram illustrating a file querying device in a distributed file system according to an embodiment of the present disclosure;
fig. 4 is a block diagram illustrating a file querying device in another distributed file system according to an embodiment of the present disclosure;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The core of the application is to provide a file query method, a file query device, an electronic device and a computer readable storage medium in a distributed file system, so that the file query process is effectively simplified, time consumption is reduced, and efficiency is improved.
In order to more clearly and completely describe the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Currently, in the prior art, when a user or an administrator needs to query some files through a client, generally using an ls command of a Linux system, under a communication mechanism corresponding to the ls command, after being called layer by an operating system, a file system, a Lib library and the like, the client can request a metadata server in a distributed system to query the files, and the response is slow; then, the metadata server sends all file information to the client, and the client performs screening query. Since all the file information is transmitted by communication, it takes a lot of time. Moreover, as the ls command in Linux has a weak filtering function and only supports some simple wildcards (such as. In view of this, the present application provides a file query method in a distributed file system, which can effectively solve the above problems.
Referring to fig. 1, an embodiment of the present application discloses a file query method in a distributed file system, which is applied to a client and mainly includes:
s101: and receiving an input filtering query instruction in a preset format.
S102: the target directory and query parameters are determined by parsing the filtered query instructions.
It should be noted that, according to the file query method provided by the application, the ls command of the Linux system is not adopted to perform file query on the metadata server request, but a set of new instruction format and a corresponding instruction analysis processing flow are set, so that the request can be sent to the metadata server without being called layer by the Linux system like the ls command, the processing process is greatly simplified, and the efficiency is improved.
Specifically, in the present application, after the client receives the input filtering query instruction in the preset format, the client may perform instruction parsing according to the preset format, so as to specify the target directory and query parameters to be subjected to file query.
As a specific embodiment, the filtering query instruction may be implemented based on a getfastr instruction, and the instruction format may specifically be:
getfattr-n icfs, dir.query. query parameter 1 ═ x.query parameter 2 ═ x.target directory;
the query parameters may specifically include the following:
type, type to be queried, type is-representing query file; type d represents a query directory;
ctime, the state change date, the format can be Y-M-D h: M: s, namely year-month-day: minute: second;
mtime, last modified date;
atime, access time;
name, file name, supporting regular expression;
gid, genus group;
uid, owner;
offset, preset offset;
limit, number of queries.
For example, the query task executed by the filter query instruction getfasttr-n icfs, dir, query, type, ctime, 2019-09-25test is to query the directory named "test" for the files created at 2019-09-25.
S103: and generating a filtering query request message carrying the target directory and the query parameters.
S104: and sending the filtering query request message to a metadata server.
Corresponding to the new instruction format set by the application, the application also adds a processing logic in the getfattr to realize the instruction analysis processing flow. Specifically, through the processing logic, the client can generate a filtering query request message and send the filtering query request message to the metadata server after analyzing and acquiring the target directory and the query parameters. The filtering query request message carries a target directory and query parameters.
S105: and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server.
Correspondingly, the application also sets message processing logic at the metadata server. Specifically, after the metadata server receives the filtering query request, the metadata server performs filtering query on the distributed file system according to the target directory and the query parameters in the filtering query request message.
It should be noted that, unlike the prior art, in the file query method provided in the present application, due to the settings of the filtering query request packet and the related processing logic, the metadata server may specifically perform filtering query on the distributed files, and only needs to return the target file data obtained by the filtering query to the client, instead of sending all the file data to the client and filtering and screening the file data by the client as in the prior art.
The file query method in the distributed file system provided by the embodiment of the application comprises the following steps: receiving an input filtering query instruction with a preset format; determining a target directory and query parameters by analyzing and filtering the query instruction; generating a filtering query request message carrying a target directory and query parameters; sending the filtering query request message to a metadata server; and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server.
Therefore, the method and the device have the advantages that a new instruction format and related instruction analysis and processing flows are set, on one hand, layer-by-layer calling of a system is omitted, and the process of sending a request to a metadata server by a client is simplified and accelerated; on the other hand, the metadata server filters and queries the local distributed file data and returns only the filtered and queried target file data to the client, and compared with the large amount of all distributed file data, the time consumption of the transmission process of the target file data is small, and the file query efficiency is further effectively improved.
On the basis of the above content, as a specific embodiment, the method for querying a file in a distributed file system according to the embodiment of the present application, where sending a filtering query request message to a metadata server, includes: calling a preset interface to send the filtering query request message to a metadata server; the preset format corresponds to a preset interface.
Further, the preset interface may specifically include a getfattr interface or a cephadaemon interface. The filter query instruction may be implemented based on the getfattr instruction or the cephadaemon instruction.
On the basis of the above content, as a specific embodiment, the method for querying a file in a distributed file system provided in the embodiment of the present application, determining a target directory and query parameters by analyzing a filtering query instruction, includes: and determining each directory fragment and query parameter of the target directory by analyzing the filtering query instruction.
In particular, when the target directory is large, i.e., contains a large number of subdirectories, in order to reduce the workload of the metadata server in filtering queries once, the target directory may be partitioned into directory fragments for filtering queries multiple times.
Referring to fig. 2, an embodiment of the present application discloses another file query method in a distributed file system, which is applied to a metadata server, and mainly includes:
s201: after the client analyzes the input filtering query instruction with the preset format to determine the target directory and the query parameters, the filtering query request message which is generated and sent by the client and carries the target directory and the query parameters is received.
S202: a filtering query is performed in the target directory according to the query parameters.
S203: and returning the inquired target file data to the client.
Therefore, the method and the device have the advantages that a new instruction format and related instruction analysis and processing flows are set, on one hand, layer-by-layer calling of a system is omitted, and the process of sending a request to a metadata server by a client is simplified and accelerated; on the other hand, the metadata server filters and queries the local distributed file data and returns only the filtered and queried target file data to the client, and compared with the large amount of all distributed file data, the time consumption of the transmission process of the target file data is small, and the file query efficiency is further effectively improved.
On the basis of the above content, in the file query method in the distributed file system provided in the embodiment of the present application, as a specific embodiment, the query parameter includes a preset offset; performing a filtered query in the target directory according to the query parameters, comprising: and executing filtering query by taking the file with the ranking larger than the preset offset in the target directory as a query object. The preset offset is used as one of the query parameters for limiting the filtering query from the +1 th file.
As a specific embodiment, the query parameters include a query number; performing a filtered query in the target directory according to the query parameters, comprising: and executing filtering query in the target directory until the number of the searched target files is equal to the query number. The query quantity limit is used as one of the query parameters to limit the total quantity of target files to be searched.
Referring to fig. 3, an embodiment of the present application discloses a file querying device in a distributed file system, which is applied to a client, and mainly includes:
the instruction processing module 301 is configured to receive an input filtering query instruction in a preset format, and determine a target directory and query parameters by analyzing the filtering query instruction;
a message generating module 302, configured to generate a filtering query request message carrying a target directory and a query parameter;
a message sending module 303, configured to send the filtering query request message to the metadata server;
and the data acquisition module 304 is configured to receive the target file data returned by the metadata server after the metadata server executes filtering query in the target directory according to the query parameters.
For the specific content of the file querying device in the distributed file system, reference may be made to the foregoing detailed description of the file querying method applied to the client, and details thereof are not repeated here.
Therefore, the file query device in the distributed file system disclosed by the embodiment of the application sets a new instruction format and a related instruction analysis and processing flow, so that on one hand, layer-by-layer calling of the system is omitted, and the process of sending a request to a metadata server by a client is simplified and accelerated; on the other hand, the metadata server filters and queries the local distributed file data and returns only the filtered and queried target file data to the client, and compared with the large amount of all distributed file data, the time consumption of the transmission process of the target file data is small, and the file query efficiency is further effectively improved.
On the basis of the above content, in a specific implementation manner of the file query apparatus in the distributed file system disclosed in the embodiment of the present application, the message sending module 303 is specifically configured to: calling a preset interface to send the filtering query request message to a metadata server; the preset format corresponds to a preset interface.
Further, the preset interface includes a getfattr interface or a cephadaemon interface.
On the basis of the foregoing, in a specific implementation manner of the file query apparatus in the distributed file system disclosed in the embodiment of the present application, the instruction processing module 301 is specifically configured to: and determining each directory fragment and query parameter of the target directory by analyzing the filtering query instruction.
Referring to fig. 4, an embodiment of the present application discloses a file querying device in another distributed file system, which is applied to a metadata server, and mainly includes:
the message receiving module 401 is configured to, after analyzing the input filtering query instruction with the preset format at the client to determine a target directory and a query parameter, receive a filtering query request message carrying the target directory and the query parameter, where the filtering query request message is generated and sent by the client;
a filtering query module 402, configured to perform a filtering query in the target directory according to the query parameter;
and a data sending module 403, configured to return the queried target file data to the client.
For the specific content of the file querying device in the distributed file system, reference may be made to the foregoing detailed description of the file querying method applied to the metadata server, and details thereof are not repeated here.
Therefore, the file query device in the distributed file system disclosed by the embodiment of the application sets a new instruction format and a related instruction analysis and processing flow, so that on one hand, layer-by-layer calling of the system is omitted, and the process of sending a request to a metadata server by a client is simplified and accelerated; on the other hand, the metadata server filters and queries the local distributed file data and returns only the filtered and queried target file data to the client, and compared with the large amount of all distributed file data, the time consumption of the transmission process of the target file data is small, and the file query efficiency is further effectively improved.
On the basis of the above content, in a specific implementation manner, the file query device in the distributed file system disclosed in the embodiment of the present application, the query parameter includes a preset offset; the filtering query module 402 is specifically configured to: and executing filtering query by taking the file with the ranking larger than the preset offset in the target directory as a query object.
On the basis of the above content, in a specific implementation manner of the file query device in the distributed file system disclosed in the embodiment of the present application, the query parameter includes a query number; the filtering query module 402 is specifically configured to: and executing filtering query in the target directory until the number of the searched target files is equal to the query number.
Referring to fig. 5, an embodiment of the present application discloses an electronic device, including:
a memory 501 for storing a computer program;
a processor 502 for executing the computer program for implementing the steps of the file query method in any of the distributed file systems as described above.
Further, the present application discloses a computer readable storage medium, in which a computer program is stored, and the computer program is used for implementing the steps of the file query method in any distributed file system as described above when being executed by a processor.
For the details of the electronic device and the computer-readable storage medium, reference may be made to the foregoing detailed description of the file querying method in the distributed file system, and details thereof are not repeated here.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the equipment disclosed by the embodiment, the description is relatively simple because the equipment corresponds to the method disclosed by the embodiment, and the relevant parts can be referred to the method part for description.
It is further noted that, throughout this document, relational terms such as "first" and "second" are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Furthermore, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The technical solutions provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, without departing from the principle of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall into the protection scope of the present application.

Claims (10)

1. A file query method in a distributed file system is applied to a client, and comprises the following steps:
receiving an input filtering query instruction with a preset format;
determining a target directory and query parameters by analyzing the filtering query instruction;
generating a filtering query request message carrying the target directory and the query parameters;
sending the filtering query request message to a metadata server;
and when the metadata server executes filtering query in the target directory according to the query parameters, receiving target file data returned by the metadata server.
2. The method according to claim 1, wherein the sending the filtering query request message to a metadata server comprises:
calling a preset interface to send the filtering query request message to the metadata server; the preset format corresponds to the preset interface.
3. The file query method according to claim 2, wherein the preset interface comprises a getfattr interface or a cephadaemon interface.
4. The method of claim 1, wherein the determining target directory and query parameters by parsing the filtered query instructions comprises:
and determining each directory fragment and the query parameter of the target directory by analyzing the filtering query instruction.
5. A file query method in a distributed file system is applied to a metadata server and comprises the following steps:
after a client analyzes an input filtering query instruction with a preset format to determine a target directory and query parameters, receiving a filtering query request message which is generated and sent by the client and carries the target directory and the query parameters;
executing a filtering query in the target directory according to the query parameters;
and returning the inquired target file data to the client.
6. The file query method of claim 5, wherein the query parameter comprises a preset offset; the executing a filtering query in the target directory according to the query parameters includes:
and executing filtering query by taking the file with the ranking larger than the preset offset in the target directory as a query object.
7. A file query device in a distributed file system is applied to a client, and comprises:
the instruction processing module is used for receiving an input filtering query instruction in a preset format and determining a target directory and query parameters by analyzing the filtering query instruction;
a message generating module, configured to generate a filtering query request message carrying the target directory and the query parameter;
the message sending module is used for sending the filtering query request message to a metadata server;
and the data acquisition module is used for receiving the target file data returned by the metadata server after the metadata server executes filtering query in the target directory according to the query parameters.
8. A file inquiry device in a distributed file system is applied to a metadata server and comprises the following components:
the message receiving module is used for analyzing an input filtering query instruction with a preset format at a client to determine a target directory and a query parameter, and then receiving a filtering query request message which is generated and sent by the client and carries the target directory and the query parameter;
the filtering query module is used for executing filtering query in the target directory according to the query parameters;
and the data sending module is used for returning the inquired target file data to the client.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the file query method in the distributed file system according to any of claims 1 to 6.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the steps of the file querying method in the distributed file system according to any one of claims 1 to 6.
CN201911082296.5A 2019-11-07 2019-11-07 File query method, device, equipment and medium in distributed file system Pending CN110888840A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911082296.5A CN110888840A (en) 2019-11-07 2019-11-07 File query method, device, equipment and medium in distributed file system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911082296.5A CN110888840A (en) 2019-11-07 2019-11-07 File query method, device, equipment and medium in distributed file system

Publications (1)

Publication Number Publication Date
CN110888840A true CN110888840A (en) 2020-03-17

Family

ID=69747022

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911082296.5A Pending CN110888840A (en) 2019-11-07 2019-11-07 File query method, device, equipment and medium in distributed file system

Country Status (1)

Country Link
CN (1) CN110888840A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112965936A (en) * 2021-02-26 2021-06-15 苏宁金融科技(南京)有限公司 Processing method, device, equipment and storage medium of heterogeneous distributed model
CN113779325A (en) * 2020-12-25 2021-12-10 北京沃东天骏信息技术有限公司 Data query method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103595761A (en) * 2013-10-15 2014-02-19 北京航空航天大学 Data processing method based on distributed file system and server
CN104462129A (en) * 2013-09-22 2015-03-25 北大方正集团有限公司 Distributed file storage and query method and distributed file access system
US20180232531A1 (en) * 2017-02-10 2018-08-16 BlueTalon, Inc. Authentication based on client access limitation
CN109063061A (en) * 2018-07-20 2018-12-21 北京百度网讯科技有限公司 Across distributed system data processing method, device, equipment and storage medium
CN109710743A (en) * 2018-12-28 2019-05-03 郑州云海信息技术有限公司 A kind of access method of storage pool, device and electronic equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104462129A (en) * 2013-09-22 2015-03-25 北大方正集团有限公司 Distributed file storage and query method and distributed file access system
CN103595761A (en) * 2013-10-15 2014-02-19 北京航空航天大学 Data processing method based on distributed file system and server
US20180232531A1 (en) * 2017-02-10 2018-08-16 BlueTalon, Inc. Authentication based on client access limitation
CN109063061A (en) * 2018-07-20 2018-12-21 北京百度网讯科技有限公司 Across distributed system data processing method, device, equipment and storage medium
CN109710743A (en) * 2018-12-28 2019-05-03 郑州云海信息技术有限公司 A kind of access method of storage pool, device and electronic equipment

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113779325A (en) * 2020-12-25 2021-12-10 北京沃东天骏信息技术有限公司 Data query method and device, storage medium and electronic equipment
CN113779325B (en) * 2020-12-25 2024-04-05 北京沃东天骏信息技术有限公司 Data query method, device, storage medium and electronic equipment
CN112965936A (en) * 2021-02-26 2021-06-15 苏宁金融科技(南京)有限公司 Processing method, device, equipment and storage medium of heterogeneous distributed model

Similar Documents

Publication Publication Date Title
CN109739815B (en) File processing method, system, device, equipment and storage medium
CN108509437B (en) ElasticSearch query acceleration method
CN110427368A (en) Data processing method, device, electronic equipment and storage medium
JP2017515180A (en) Processing data sets in big data repositories
CN111324606B (en) Data slicing method and device
CN105677904B (en) Small documents storage method and device based on distributed file system
CN104035938A (en) Performance continuous integration data processing method and device
CN109766206A (en) A kind of log collection method and system
CN110888840A (en) File query method, device, equipment and medium in distributed file system
CN111782692A (en) Frequency control method and device
CN105653697A (en) Recommended word retrieval method and system
US9390131B1 (en) Executing queries subject to different consistency requirements
CN113778947A (en) Data import method, device and equipment of kafka stream processing platform
CN108897858A (en) The appraisal procedure and device, electronic equipment of distributed type assemblies index fragment
US10394771B2 (en) Use of search templates to identify slow information server search patterns
JP6242087B2 (en) Document management server, document management method, computer program
CN113407356A (en) Data processing method and device, electronic equipment and storage medium
CN112084199A (en) Scene-based general parameter maintenance method and device
CN112035207A (en) Page menu dynamic loading method and device based on database
CN101388790B (en) Method for importing radio network performance data
CN112579633A (en) Data retrieval method, device, equipment and storage medium
CN106446080B (en) Data query method, query service equipment, client equipment and data system
CN108664503B (en) Data archiving method and device
CN109769027A (en) A kind of information push method, device and equipment
CN107070987B (en) Data acquisition method and system for distributed object storage system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200317

RJ01 Rejection of invention patent application after publication