CN114896279A - Data query method, device, equipment and readable storage medium - Google Patents

Abstract

The application discloses a data query method, a data query device, data query equipment and a readable storage medium, and relates to the field of data analysis. The method comprises the following steps: receiving a query request, wherein the query request indicates data information of target data in a universal language format, and the data information comprises a target data source identifier of a data source where the target data is located and query keywords of the target data; based on the target data source identification, positioning a target data source where the target data is located, wherein registration information corresponding to at least two data sources is stored in the proxy query server, and the registration information is used for realizing conversion between the language format of the data sources and the universal language format; and acquiring target data from the target data source based on the query keywords and the registration information. The time for inquiring different data source data is reduced to a certain extent, and the repeated writing work caused by exporting converted files generated in the inquiring process is avoided to a certain extent.

Description

Data query method, apparatus, device and readable storage medium

technical field

The embodiments of the present application relate to the field of data analysis, and in particular, to a data query method, apparatus, device, and readable storage medium.

Background technique

With the improvement of office automation, each field has a corresponding automated office system. The office automation system in each field is independently developed and has its own independent software system and data. The data system between different fields needs to be Do complex data format conversion and export/import work.

In the data query of different fields in the related art, it is generally necessary to do an intermediate data conversion first, specifically, the source system exports the data required by the destination system to become an intermediate file; and converts the intermediate file into a process that the destination system can process. data files; and then import the data files into the destination system to realize data query between different data sources.

However, in the related art, each time the data is exported, converted and rewritten requires a large number of Input/Output (IO) operations, which takes a long time and will have a certain impact on the normal operation of the online service; and When querying data from different data sources, each system is constantly generating new data, which requires regular data synchronization. Every time data synchronization, it is inevitable to repeatedly go through export, transformation and writing, resulting in a lot of repetitive work.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a data query method, apparatus, device, and readable storage medium, which can improve the query speed in the data query process. The technical solution is as follows:

In one aspect, a data query method is provided, the method comprising:

receiving a query request, where the query request indicates data information of the target data in a common language format, and the data information includes a target data source identifier of a data source where the target data is located and a query keyword of the target data;

Based on the target data source identifier, locate the target data source where the target data is located, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to implement the language of the data sources conversion between formats and said common language formats;

The target data is acquired from the target data source based on the query keyword and the registration information.

In an optional embodiment, before locating the target data source where the target data is located based on the target data source identifier, the method further includes:

Receive stored data information uploaded by the at least two data sources in the common language format, where the stored data information includes data source identifiers, data source data information, and data source path information of the at least two data sources, and The data source identifier is used to uniquely indicate the data source, and the data source data information is used to indicate the data content of the data source;

The registration information is obtained by registering the stored data information, and a data query interface is configured for the at least two data sources.

In an optional embodiment, the proxy query server includes a registration information table;

The registration of the stored data information to obtain registration information includes:

registering the stored data information in the registration information table to obtain registration information corresponding to the at least two data sources respectively;

or,

The stored data information corresponding to the at least two data sources is respectively registered in the corresponding registration information table, and the registration information table corresponding to the at least two data sources is obtained, and the i-th registration information table includes the i-th registration information table. The registration information corresponding to the data source, i is a positive integer.

In an optional embodiment, locating the target data source where the target data is located based on the target data source identifier includes:

Parsing the query request to obtain the target data source identifier in the query request;

Based on the target data source identifier, a target data source path corresponding to the target data source identifier is determined, and the target data source path is a storage location path of the target data source.

In an optional embodiment, the obtaining the target data from the target data source based on the query keyword and the registration information includes:

Determine, based on the target data source identifier, a target data query interface corresponding to the target data source identifier;

Based on the query keyword, the target data is acquired from the target data source stored on the target data source path through the target data query interface.

In an optional embodiment, the obtaining the target data from the target data source stored on the target data source path through the target data query interface based on the query keyword includes:

Convert the query keyword into a query statement corresponding to the target data source through the target data query interface;

Send the query statement to the target data source based on the target data source path;

The target data fed back by the target data source is received.

In an optional embodiment, the query request also includes target computing requirements;

After obtaining the target data from the target data source, the method further includes:

Calculate and process the target data based on the target calculation requirements to obtain a query result corresponding to the target data;

Send the query result to the data processing terminal.

In another aspect, a data query device is provided, the device comprising:

A receiving module, configured to receive a query request, where the query request indicates data information of target data in a common language format, and the data information includes the target data source identifier of the data source where the target data is located and the query key of the target data Character;

A positioning module, configured to locate the target data source where the target data is located based on the target data source identifier, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to realize all conversion between the language format of the data source and the common language format;

an obtaining module, configured to obtain the target data from the target data source based on the query keyword and the registration information.

In another aspect, a computer device is provided, the computer device includes a processor and a memory, the memory stores at least one instruction, at least a section of a program, a code set or an instruction set, the at least one instruction, the at least one A piece of program, the code set or the instruction set is loaded and executed by the processor to implement the data query method as described in any of the foregoing embodiments of the present application.

In another aspect, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, at least one piece of program, code set or instruction set, the at least one instruction, the at least one piece of program, the code The set or instruction set is loaded and executed by the processor to implement the data query method described in any of the foregoing embodiments of the present application.

In another aspect, a computer program product is provided, which, when the computer program product runs on a computer, causes the computer to execute the data query method described in any of the foregoing embodiments of the present application.

The beneficial effects brought by the technical solutions provided in the embodiments of the present application include at least:

Before querying data information in different data sources, at least two data sources register corresponding registration information in the proxy query server, and the proxy query server configures corresponding data query interfaces for the at least two data sources; thus, the proxy query server receives the query At the time of request, the corresponding data source can be selected from multiple data sources for data query and acquisition based on the target data source identifier and query keyword, which reduces the time for acquiring data from different data sources, and reduces the amount of data generated during the query process. The export of transform files brings rewrite work.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;

2 is a flowchart of a data query method provided by an exemplary embodiment of the present application;

3 is a flowchart of a data query method provided by another exemplary embodiment of the present application;

4 is a flowchart of a data query method provided by another exemplary embodiment of the present application;

5 is a structural block diagram of a data query apparatus provided by an exemplary embodiment of the present application;

6 is a structural block diagram of a data query apparatus provided by another exemplary embodiment of the present application;

FIG. 7 is a structural block diagram of a proxy query server provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

FIG. 1 is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application. As shown in FIG. 1 , the implementation environment includes a terminal 110 , a proxy query server 120 and multiple data sources 130 , and the terminal 110 includes a terminal A111 and a terminal B112 , the multiple data sources 130 include a data source a131, a data source b132 and a data source c133.

The user sends a query request to the proxy query server 120 through the terminal 110 to query the data information in the data source 130, and the query request includes the data source identifier and the query keyword.

In the embodiment of the present application, by constructing a general proxy query server 120, a plurality of data sources 130 register their corresponding stored data information in the proxy query server 120, and the stored data information includes the data source identifier and the data storage location. Path and structure information. The structure information is used to indicate the storage structure of the data content in the data source. In some embodiments, the structure information includes query keywords used by the user when querying the target data. For example: the salary details of the company personnel are stored in the data source, including the months corresponding to the personnel and the personnel, and the data values are included in the corresponding relationship between the personnel and the month, such as: the corresponding relationship between Zhang San and October includes data The value of 5000 is used to indicate that Zhang San's salary in October is 5000. When registering in the proxy query server 120, the structure information corresponding to Zhang San and October is stored in the proxy query server 120. Select Zhang San as the query keyword in the terminal to query the salary information corresponding to Zhang San in the data source.

Optionally, the stored data information of different data sources is registered in the proxy query server 120 through a common language format, where the common language format is Structured Query Language (SQL for short).

Optionally, when multiple data sources 130 register the corresponding registration information in the proxy query server 120, the corresponding data source identification, structure information and data storage location path are registered in the corresponding registration information table, and the user queries the target data. When the proxy query server 120 parses the query request, and learns the target data source identifier and query keyword; based on the target data source identifier and query keyword, the proxy query server 120 searches the target data source through the target data query interface corresponding to the target data source. Get the target data corresponding to the query keyword.

The proxy query server 120 includes a data query interface (not shown in FIG. 1 ) corresponding to each data source 130 . For example, the proxy query server 120 receives the registration information from the data source a131, the data source b132 and the data source c133 respectively, and formulates the query interface 1 for the data source a131, the query interface 2 for the data source b132 and the data source c133. Query interface 3.

The proxy query server 120 receives the query request from the terminal A111; parses the query request to obtain the target data source identifier and the query keyword; the proxy query server 120 locates the target data source based on the target data source identifier, and corresponds to the target data source through the target data source. The target query interface to query target data. In some embodiments, the query request includes a target data source identifier of a single target data source, indicating that the target data is obtained from the single data source; or, the query request includes target data source identifiers of multiple target data sources, indicating that the target data is obtained from the single data source. Obtain target data from multiple data sources.

Optionally, the query request includes calculation requirements for the target data, and the proxy query server 120 performs corresponding calculation processing on the target data based on the calculation requirements. For example, the calculation requirements are requirements such as data calculation, data classification, data statistics, and data projection.

The proxy query server 120 processes the target data based on the calculation requirements to obtain query results. The proxy query server 120 feeds back the query result to the preset position of the terminal 110 for display. For example, the user initiates a query request on the terminal A111, the proxy query server 120 obtains the final query result according to the query request, and feeds back the query result to the terminal B112; alternatively, the terminal A111 can also be used to receive the query result, and the terminal B can also use For initiating a query request, this application does not limit it.

It is worth noting that the above-mentioned terminal 110 can be implemented as a mobile terminal such as a mobile phone, a tablet computer, a wearable device, a portable laptop computer, etc., or can also be implemented as a terminal such as a desktop computer, an electronic game console, etc. limited.

The proxy query server 120 may be implemented as a single server, or as a server cluster composed of multiple servers. The server 120 may be implemented as a physical server or a cloud server, which is not limited in this embodiment of the present application.

In combination with the above implementation environment, the data query method involved in the embodiments of the present application will be described. FIG. 2 is a flowchart of an exemplary data query method provided by the present application, and the method is applied to a proxy query server, as shown in FIG. 2 . , the method includes:

Step 210: Receive a query request. The query request indicates data information of the target data in a common language format. The data information includes a target data source identifier of the data source where the target data is located and a query keyword of the target data.

The application scenario in which the user queries the target data in the terminal includes at least one of the following situations:

First, an application program for querying data from multiple data sources is installed in the terminal, and the corresponding target data is selected in the query interface in the application program to query; exemplarily, the user can enter the corresponding query keyword in the query interface to query. Inquire.

Second, the terminal has a platform or system for querying data from multiple data sources. Exemplarily, the user selects corresponding target data for querying in a web interface corresponding to a query service.

It should be noted that the above application scenarios are only exemplary, and the application scenarios for querying the target data of the present application are not limited.

The manner in which the terminal sends a query request to the server includes at least one of the following situations:

First, the user enters a query keyword in the terminal where the query application program is installed, the query keyword is used to locate the target data in the data source, and the query keyword includes the target data source keyword corresponding to the target data and the data content. the corresponding keyword. Illustratively, taking the user querying the salary slip as an example, the user enters keywords: "Zhang San" and "October" on the terminal to instruct to query the salary details of Zhang San in October. The terminal receives the keyword entered by the user; converts it into a query statement in a common language format, attaches it to the query request, and uploads it to the proxy query server. The proxy query server queries the salary details of Zhang San in October in the corresponding data source. And return the target data obtained by the query to the terminal.

Second, a corresponding data acquisition scheme is preset in the terminal, and the data acquisition scheme includes the target data source identifier and the query keyword. When the user queries the target data, the terminal selects the data acquisition scheme that matches the user's query target data. , the terminal converts the data acquisition scheme selected by the user into a query statement in a common language format, attaches it to the query request, and uploads it to the proxy query server; the proxy query server locates the target data source based on the query statement, and selects the target data source according to the query keyword. Get target data.

Third, the terminal is provided with a function control corresponding to the query target data. The user can perform data query by clicking the corresponding control in the query interface, and the function control is correspondingly set with the corresponding target data source identifier and query keyword; after the user clicks the control, the terminal A query statement that converts the target data source identifier and query keyword into a common language format is attached to the query request and uploaded to the proxy query server.

In some embodiments, when different data sources save the corresponding registration information in the proxy query server, they all use the common language format for storage. After the proxy query server uses the common language format to parse the query request, it obtains the Target data source identifier and query keywords.

Before the proxy query server receives the query request, the process of registering the data source with the proxy query service is also included.

That is, the proxy query server receives stored data information uploaded by at least two data sources in a common language format, where the stored data information includes data source identifiers, data source data information and data source path information of the at least two data sources. The data source identifier is used to uniquely indicate the data source, and the data source information is used to indicate the data source content of the data source. It is worth noting that the data source information is not implemented as the data source content itself in the data source, but is used to indicate the storage information of the data in the data source, such as storage format, storage structure, and so on.

In the embodiment of the present application, the at least two data source information uploads the stored data information corresponding to itself in the SQL language format to the proxy query server to complete the registration.

In some embodiments, after receiving the stored data information uploaded by the data source, the proxy query server registers the stored data information to obtain the registration information, and configures a data query structure for at least two data sources.

In some embodiments, the registration process of the data source is actively performed by the data source side; or, the registration process of the data source is completed based on the registration instruction of the proxy query server. Illustratively, when the data storage structure in the data source changes, or the data storage format in the data source changes, a registration update request is sent to the proxy query server, so as to realize the update registration in the proxy query server (that is, the data source). Or, in the initial stage of the setting of the proxy query server, after the proxy query server establishes a connection with each data source, it sends a registration instruction to each data source, so that each data source sends the stored data information to the proxy query server based on the registration instruction. to register.

The data source path information is used to indicate the storage location path of the data source. Exemplarily, if the stored data information includes "Hive" and "http//C.html", it means that the data source stores the data in http//C.html on the path.

It should be noted that the format of the stored data information involved in the above example is only an example, and the stored data information may also be expressed in other formats, which is not limited in this application.

The proxy query server registers the stored data information to obtain the registration information, and configures a data query interface for the corresponding data source. Exemplarily, the proxy query server performs registration based on the data source Hive and storage data information of the data source HDFS, and configures a Hive data query interface and an HDFS data query interface for the data source Hive and the data source HDFS, respectively.

Step 220, based on the target data source identifier, locate the target data source where the target data is located, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to realize the data source between the language format and the common language format. conversion.

After receiving the query request, the proxy query server parses the query request to obtain the target data source identifier and query keyword included in the query request; The data source path is the storage location path of the target data source.

Before receiving the query request, at least two data sources register the stored data information generated by themselves with the proxy query server in the form of a registration information table; therefore, the proxy server includes a registration information table, and after the proxy query server obtains the target data source identifier , and query the corresponding target data source in the registration information table based on the target data source identifier in the query request.

That is, the proxy query server includes a registration information table, and during the registration process, the stored data information is registered in the registration information table to obtain registration information corresponding to at least two data sources respectively; or, at least two data sources are corresponding to The stored data information is registered in the corresponding registration information table respectively, and the corresponding registration information tables of at least two data sources are obtained, wherein the i-th registration information table includes the registration information corresponding to the i-th data source, and i is a positive Integer.

That is, the registration information table is implemented as a table containing the registration information of the overall data source; alternatively, the registration information table is implemented as a separate table for each data source.

In some embodiments, when the data source registers with the proxy query server, the proxy query server stores the corresponding storage location path of the data source in the registration information table, so that the proxy query server obtains the target data source identifier from the query request Then, the storage location path corresponding to the target data source can be determined from the registration information table based on the target data source identifier, that is, the target data source where the target data is located can be located.

Illustratively, the registration information table includes: data source identifier, data source structure, data source interface information, data source storage location path, data source language format, etc. corresponding to the data source.

Step 230: Acquire target data from the target data source based on the query keyword and the registration information.

After determining the target data source where the target data is located based on the target data source identifier, the proxy query server obtains the corresponding target data from the target data source based on the query keyword.

In some embodiments, the target data source stores data in the form of key-value pairs, that is, the data (value) corresponding to the key can be determined from the target data source based on the key (key). Therefore, in the embodiment of the present application, after determining the query keyword from the query request, the proxy query server obtains the query result from the target data source in the language format corresponding to the target data source through the data query interface corresponding to the target data source. The target data corresponding to the keyword.

To sum up, in the data query method provided by this embodiment, before querying data information in different data sources, at least two data sources register the corresponding registration information in the proxy query server, and the proxy query server is configured for at least two data sources Corresponding data query interface; thus, when the proxy query server receives a query request, it can select the corresponding data source from multiple data sources for data query and acquisition based on the target data source identifier and query keyword, which reduces the need for data query from different data sources. The time for the source to obtain data, and the repeated writing work caused by the export conversion file generated during the query process is reduced.

Fig. 3 is a flow chart of a data query method provided by another exemplary embodiment of the present application. The method is applied to a proxy query server as an example for description. As shown in Fig. 3, the method includes:

Step 310: Receive a query request. The query request indicates data information of the target data in a common language format. The data information includes a target data source identifier of the data source where the target data is located and a query keyword of the target data.

The process of receiving the query request has been described in the above step 210, and will not be repeated here.

Step 320: Parse the query request to obtain the target data source identifier and the query keyword of the target data in the query request.

In some embodiments, the proxy query server parses the query request in a common language format, so as to obtain the target data source identifier and the query keyword from the query request, so as to realize the data query. Wherein, the target data source identifier is used to locate the target data source where the target data is stored, and the query key is used to locate the storage keyword key corresponding to the target data in the data source.

The server has registration information corresponding to multiple data sources registered in the server. According to the target data source identifier and registration information, the storage location path where the target data source is located (that is, the storage location of the target data source) can be located; The storage location of the target data in the target data source.

Among them, due to the different storage methods such as storage structures and storage languages corresponding to multiple data sources, the multiple data sources have been registered in the proxy query server, and the format based on the registration information has been unified, so that the terminal can use the The unified common language format queries the proxy server, and the proxy server obtains data from different data sources based on the data storage types corresponding to different data sources.

That is, the identifier of the target data source involved in the above query request may be one or multiple.

Step 330 , based on the target data source identifier, determine the target data source path corresponding to the target data source identifier, and the target data source path is the storage location path of the target data source.

The target data source path is the storage location path of the target data source, that is, the target data source path is the storage location of the target data.

Step 340 , based on the target data source identifier, determine the target data query interface corresponding to the target data source identifier.

After the proxy query server parses the query request to obtain the target data source, it determines the target data query interface corresponding to the target data source identifier, wherein the data query interface is an interface configured by the proxy query server to the data source to realize data acquisition.

Step 350 , based on the query keyword, obtain the target data from the target data source stored on the target data source path through the target data query interface.

In some embodiments, when performing data query through the target data query structure, the query keyword is converted into a query statement corresponding to the target data source through the target data query structure, and the query statement is sent to the target data source based on the target data source path, and Receive target data fed back by the target data source.

The proxy query server obtains the target data from the target data source through the target data query interface according to the query keyword in the query request. Exemplarily, the query request is Hive: 20200101-20200103, and the request is used to instruct to query the data information in the data source Hive from January 01, 2020 to January 03, 2020. The proxy query server determines the Hive based on the data source identifier. The target storage location path of the data source Hive is http://b.com. The proxy query server obtains the data generated from January 1, 2020 to January 3, 2020 from the path http://b.com through the Hive query interface. information.

The proxy query server receives the target data returned by the target data source, and feeds back the target data to the terminal that sent the query request, or feeds back the target data to another terminal, which is not limited in this application.

To sum up, in the data query method provided by this embodiment, before querying data information in different data sources, at least two data sources register the corresponding registration information in the proxy query server, and the proxy query server is configured for at least two data sources The corresponding data query interface; thus, when the proxy query server receives a query request, it obtains the target data from the data query interface of the corresponding data source according to the target data storage path, avoiding the query time caused by querying the storage path in all databases. Too long, reducing the time required to obtain the target data.

Fig. 4 is a flow chart of a data query method provided by another exemplary embodiment of the present application. The method is applied to a proxy query server as an example for description. As shown in Fig. 4 , the method includes:

Step 410: Receive a query request, where the query request includes a target data source identifier, a query keyword, and a calculation requirement.

The query keyword is used to query the target data in the data source, and the target data can be data content that can be stored, such as numbers, time, images, and videos.

The calculation requirements are used to indicate the requirements for corresponding processing of the target data, and the calculation requirements may include numerical calculation, classification, statistics, image processing, video processing/projection and other requirements for processing the above target data.

Step 420: Based on the target data source identifier, locate the target data source where the target data is located; and obtain the target data from the target data source.

The process of this step is the same as the process of step 220 to step 230, and will not be repeated here.

Step 430 , perform calculation processing on the target data based on the target calculation requirements, and obtain a query result corresponding to the target data.

Optionally, the proxy query server receives the target data returned by the target data query interface, parses the query request again (this step can also be completed in step 410, which is not limited in this application), and obtains the calculation requirements in the query request, Based on the calculation requirement, the target data is processed correspondingly to obtain a query result, and the proxy query server feeds back the query interface to the terminal, which may be the terminal that initiated the query request or other terminals.

To sum up, in the data query method provided by this embodiment, before querying data information in different data sources, at least two data sources register the corresponding registration information in the proxy query server, and the proxy query server is configured for at least two data sources Corresponding data query interface; so that when the proxy query server receives a query request, it can select a corresponding data source from multiple data sources based on the target data source identifier and query keyword for data query and acquisition, and after acquiring the target data, The target data is processed based on the user's computing requirements, which reduces the time to obtain data from different data sources, and reduces the repetitive writing work caused by the export and conversion files generated in the query process, effectively shortening the processing time of the target data. calculating speed.

FIG. 5 is a structural block diagram of a payment device for exchanging resources provided by an exemplary embodiment of the present application. As shown in FIG. 5 , the device includes: a receiving module 510, a positioning module 520, and an obtaining module 530;

The receiving module 510 is configured to receive a query request, where the query request indicates the data information of the target data in a common language format, and the data information includes the target data source identifier of the data source where the target data is located and the query of the target data keyword;

The positioning module 520 is configured to locate the target data source where the target data is located based on the target data source identifier, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to realize conversion between the language format of the data source and the common language format;

The obtaining module 530 is configured to obtain the target data from the target data source based on the query keyword and the registration information.

In an optional embodiment, as shown in FIG. 6 , the apparatus further includes:

The receiving module 510 is further configured to receive stored data information uploaded by the at least two data sources in the common language format, where the stored data information includes data source identifiers and data sources of the at least two data sources. data information and data source path information, the data source identifier is used to uniquely indicate the data source, and the data source data information is used to indicate the data content of the data source;

The registration module 540 is configured to register the stored data information to obtain the registration information, and configure a data query interface for the at least two data sources.

In an optional embodiment, as shown in FIG. 6 , the registration module 540 further includes: a first registration unit 5410 and a second registration unit 5420;

The first registration unit 5410 is configured to register the stored data information in the registration information table to obtain registration information corresponding to the at least two data sources respectively;

The second registration unit 5420 is configured to register the stored data information corresponding to the at least two data sources into the corresponding registration information table, respectively, to obtain the registration information table corresponding to the at least two data sources, the first The i registration information tables include registration information corresponding to the i-th data source, where i is a positive integer.

In an optional embodiment, as shown in FIG. 6 , the apparatus further includes:

A parsing module 550, configured to parse the query request to obtain the target data source identifier in the query request;

The location module 520 is further configured to determine, based on the target data source identifier, a target data source path corresponding to the target data source identifier, where the target data source path is a storage location path of the target data source.

In an optional embodiment, as shown in FIG. 6 , the apparatus further includes:

The positioning module 520 is further configured to determine a target data query interface corresponding to the target data source identifier based on the target data source identifier;

The obtaining module 530 is further configured to obtain the target data from the target data source stored on the target data source path through the target data query interface based on the query keyword.

In an optional embodiment, as shown in FIG. 6 , the obtaining module 530 is further configured to convert the query keyword into a query statement corresponding to the target data source through the target data query interface; Send the query statement to the target data source based on the target data source path; and receive the target data fed back by the target data source.

In an optional embodiment, as shown in FIG. 6 , the apparatus further includes:

The sending module 560 is configured to perform calculation processing on the target data based on the target calculation requirements to obtain a query result corresponding to the target data; and send the query result to a data processing terminal.

To sum up, in the data query device provided in this embodiment, before querying data information in different data sources, at least two data sources actively register the data generated by themselves into the proxy query server, and the proxy query server is at least two data sources. Configure the corresponding data query interface; and based on the target data source identifier and query keyword in the query request, the proxy query server obtains the corresponding target data in the target data source through the target data query interface. To a certain extent, the time for querying data from different data sources is reduced, and to a certain extent, the repeated writing work caused by the export and conversion files generated during the query process is avoided.

It should be noted that: the data query device provided by the above embodiment is only illustrated by the division of the above functional modules. In practical applications, the above functions can be allocated to different functional modules according to needs. It is divided into different functional modules to complete all or part of the functions described above. In addition, the data query device and the data query method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

FIG. 7 shows a schematic structural diagram of a proxy query server provided by an exemplary embodiment of the present application. The proxy query server may be the proxy query server shown in FIG. 1 . Specifically:

The proxy query server 120 includes a central processing unit (CPU, Central Processing Unit) 701, a system memory 704 including a random access memory (RAM, Random Access Memory) 702 and a read only memory (ROM, Read Only Memory) 703, and is connected to the system memory 704 and the system bus 705 of the central processing unit 701 . The proxy query server 120 also includes a basic input/output system (I/O system, Input Output System) 706 that helps to transfer information between various devices in the computer, and is used to store the operating system 713, application programs 714 and other program modules 715 The mass storage device 707.

The basic input/output system 706 includes a display 708 for displaying information and input devices 709 such as a mouse, keyboard, etc., for user input of information. Both the display 708 and the input device 709 are connected to the central processing unit 701 through an input output controller 710 connected to the system bus 705 . The basic input/output system 706 may also include an input output controller 710 for receiving and processing input from various other devices such as a keyboard, mouse, or electronic stylus. Similarly, input output controller 710 also provides output to a display screen, printer, or other type of output device.

Mass storage device 707 is connected to central processing unit 701 through a mass storage controller (not shown) connected to system bus 705 . Mass storage device 707 and its associated computer-readable media provide non-volatile storage for proxy query server 120 . That is, the mass storage device 707 may include a computer-readable medium (not shown) such as a hard disk or a Compact Disc Read Only Memory (CD-ROM) drive.

Without loss of generality, computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM, Erasable Programmable Read Only Memory), Electrically Erasable Programmable Read Only Memory (EEPROM, Electrically Erasable Programmable Read Only Memory), flash memory, or other solid-state storage devices , CD-ROM, Digital Versatile Disc (DVD, Digital Versatile Disc) or other optical storage, cassette, magnetic tape, magnetic disk storage or other magnetic storage device. Of course, those skilled in the art know that the computer storage medium is not limited to the above-mentioned types. The system memory 704 and the mass storage device 707 described above may be collectively referred to as memory.

According to various embodiments of the present application, the proxy query server 120 may also run on a remote computer connected to a network through a network such as the Internet. That is, the proxy query server 120 can be connected to the network 712 through the network interface unit 711 connected to the system bus 705, or can also use the network interface unit 711 to connect to other types of networks or remote computer systems (not shown) .

The above-mentioned memory also includes one or more programs, and the one or more programs are stored in the memory and configured to be executed by the CPU.

Embodiments of the present application also provide a computer device, the computing mobile phone device includes a processor and a memory, and the memory stores at least one instruction, at least one program, code set or instruction set, at least one instruction, at least one program, The code set or instruction set is loaded and executed by the processor to implement the data query method provided by the above method embodiments.

Embodiments of the present application also provide a computer-readable storage medium, on which is stored at least one instruction, at least one piece of program, code set or instruction set, at least one instruction, at least one piece of program, code set or The instruction set is loaded and executed by the processor to implement the data query method provided by the above method embodiments.

Optionally, the computer-readable storage medium may include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), Solid State Drives (SSD, Solid State Drives), or an optical disc. The random access memory may include a resistive random access memory (ReRAM, Resistance Random Access Memory) and a dynamic random access memory (DRAM, Dynamic Random Access Memory). The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only optional embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims (10)

1. a data query method, is characterized in that, is applied in the proxy query server in the server, and described method comprises: receiving a query request, where the query request indicates data information of the target data in a common language format, and the data information includes a target data source identifier of a data source where the target data is located and a query keyword of the target data; Based on the target data source identifier, locate the target data source where the target data is located, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to implement the language of the data sources conversion between formats and said common language formats; The target data is acquired from the target data source based on the query keyword and the registration information. 2. The method according to claim 1, wherein, before locating the target data source where the target data is located based on the target data source identifier, the method further comprises: Receive stored data information uploaded by the at least two data sources in the common language format, where the stored data information includes data source identifiers, data source data information, and data source path information of the at least two data sources, and The data source identifier is used to uniquely indicate the data source, and the data source data information is used to indicate the data content of the data source; The registration information is obtained by registering the stored data information, and a data query interface is configured for the at least two data sources. 3. The method according to claim 1, wherein the proxy query server comprises a registration information table; The registration of the stored data information to obtain the registration information includes: registering the stored data information in the registration information table to obtain registration information corresponding to the at least two data sources respectively; or, The stored data information corresponding to the at least two data sources is respectively registered in the corresponding registration information table, and the registration information table corresponding to the at least two data sources is obtained, and the i-th registration information table includes the i-th registration information table. The registration information corresponding to the data source, i is a positive integer. 4. The method according to any one of claims 1 to 3, wherein the locating the target data source where the target data is located based on the target data source identifier comprises: Parsing the query request to obtain the target data source identifier in the query request; Based on the target data source identifier, a target data source path corresponding to the target data source identifier is determined, and the target data source path is a storage location path of the target data source. 5. The method according to claim 4, wherein the obtaining the target data from the target data source based on the query keyword and the registration information comprises: Determine, based on the target data source identifier, a target data query interface corresponding to the target data source identifier; Based on the query keyword, the target data is acquired from the target data source stored on the target data source path through the target data query interface. 6 . The method according to claim 5 , wherein, based on the query keyword, the target data source is obtained from the target data source stored on the target data source path through the target data query interface. 7 . target data, including: Convert the query keyword into a query statement corresponding to the target data source through the target data query interface; Send the query statement to the target data source based on the target data source path; The target data fed back by the target data source is received. 7. The method according to claim 5, wherein the query request further comprises target computing requirements; After obtaining the target data from the target data source, the method further includes: Calculate and process the target data based on the target calculation requirements to obtain a query result corresponding to the target data; Send the query result to the data processing terminal. 8. A data query device, wherein the device comprises: A receiving module, configured to receive a query request, where the query request indicates data information of target data in a common language format, and the data information includes the target data source identifier of the data source where the target data is located and the query key of the target data Character; A positioning module, configured to locate the target data source where the target data is located based on the target data source identifier, the proxy query server stores registration information corresponding to at least two data sources, and the registration information is used to realize all conversion between the language format of the data source and the common language format; an obtaining module, configured to obtain the target data from the target data source based on the query keyword and the registration information. 9. A computer device, characterized in that the computer device comprises a processor and a memory, and the memory stores at least a section of a program, the at least a section of the program is loaded and executed by the processor to implement the method as claimed in claim 1 Any one of the data query methods described in 7. 10. A computer-readable storage medium, wherein the storage medium stores at least a piece of program, and the at least one piece of program is loaded and executed by a processor to realize the data according to any one of claims 1 to 7 query method.

Images