CN109542954A - A kind of data query method and system of unified interface - Google Patents

Abstract

The present invention relates to a kind of data query method and system of unified interface, this method comprises: UDI instruction is passed in SDL engine by UDI terminal as post parameter when receiving UDI instruction；UDI instruction is converted into data base querying and instructs and execute inquiry operation by SDL engine, and the data set that inquiry obtains is returned to UDI terminal；The access way that UDI terminal is selected according to user calls corresponding function, and the data set that inquiry obtains is exported as to the data file of format corresponding with the access way of user's selection.The present invention passes through the construction of data application tool, shields the direct operation of statistical service personnel and external system to data warehouse, ensure that the Information Security of data warehouse；The UDI designed on the basis of statistical service reduces the difficulty of statistical service personnel's operation data；Shield the compatibility of data in different formats in query data repository library.

Description

A kind of data query method and system of unified interface

Technical field

The present invention relates to statistical analysis fields, and in particular to a kind of data query method and system of unified interface.

Background technique

With the development of big data, data mining the relevant technologies, more and more people notice hidden under big data it is huge Big economic value, therefore various analysis of statistical data tools emerge one after another.Such as R, Python, SAS, SPSS, Tableau, Stata, EViews, mark's prestige etc..The worker for being engaged in big data analysis not only needs to be grasped relevant business and knows Know, it is also necessary to corresponding data statistic analysis tool have it is certain grasp and understand, this proposes analysis personnel very high It is required that.There may be following predicaments when data statistics business personnel states analysis tool in use at present:

(1) business personnel needs to be grasped a variety of analysis tools and its corresponding data manipulation mode；

(2) business personnel directly operates data warehouse when inquiring data, it is difficult to guarantee the safety of data warehouse Property；

(3) analysis personnel cannot the effective operation data in the way of statistical service.

Summary of the invention

In view of the above technical problems, the present invention provides a kind of data query method and system of unified interface.

The technical scheme to solve the above technical problems is that a kind of data query method of unified interface, comprising:

Step 1, when receiving the uniform data query interface UDI instruction of user terminal transmission, UDI terminal will be described UDI instruction is passed in statistical data language SDL engine as post parameter；

UDI instruction is converted into data base querying and instructs and execute inquiry operation by step 2, the SDL engine, will be looked into It askes obtained data set and returns to the UDI terminal；

The access way that step 3, the UDI terminal are selected according to user, calls corresponding function, and the inquiry is obtained Data set export as and the data file of the corresponding format of access way of user selection.

For achieving the above object, the present invention also provides a kind of data query systems of unified interface, comprising: UDI is whole End and SDL engine；

The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by institute UDI instruction is stated to be passed in statistical data language SDL engine as post parameter；

The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will look into It askes obtained data set and returns to the UDI terminal；

The UDI terminal is also used to the access way selected according to user, calls corresponding function, inquire described To data set export as and the data file of the corresponding format of access way of user selection.

The beneficial effects of the present invention are: constituting the data that data warehouse is matched, is made of UDI terminal and SDL engine Application tool system shields statistical service personnel and external system to data warehouse by the construction of data application tool It directly operates, ensure that the Information Security of data warehouse；The UDI terminal designed on the basis of statistical service, reduces statistics The difficulty of business personnel's operation data；Data file is exported by calling function corresponding with selected access way, is shielded The compatibility for having covered data in different formats in query data repository library allows more statistical service personnel flexibly to be looked into according to need of work The arbitrary data of data warehouse is ask, to provide guarantee deeper into more fully development analysis of statistical data and utilization.

Detailed description of the invention

Fig. 1 is a kind of flow chart of the data query method of unified interface provided in an embodiment of the present invention.

Specific embodiment

The principle and features of the present invention will be described below with reference to the accompanying drawings, and the given examples are served only to explain the present invention, and It is non-to be used to limit the scope of the invention.

Fig. 1 is a kind of flow chart of the data query method of unified interface provided in an embodiment of the present invention, as shown in Figure 1, This method comprises:

S1, when receive user terminal transmission uniform data query interface UDI instruction when, UDI terminal refers to the UDI It enables and being passed in statistical data language SDL engine as post parameter；

Specifically, UDI (unified data interface, uniform data query interface) can provide based on R and The expanding packet of Python, the function that R or Python expanding packet provides both had followed the grammer of R or Python, and towards industry The statistical data language of business, the function that business analyst directly can use expanding packet to provide in R and Python terminal Carry out data analysis.Expanding packet provides data and metadata query function abundant.Such as it is to the function of data query Sdl.data (), the parameter of the function are the query interface and screening conditions for arbitrarily meeting statistical service theory.Third party's access When only need to call fixed API, and the description of statistical data query language is passed to SDL (Statistics as post parameter Data Language, statistical data language) engine.

UDI instruction is converted into data base querying and instructs and execute inquiry operation by S2, the SDL engine, will be inquired Obtained data set returns to the UDI terminal；

Optionally, in this embodiment, step S2 is specifically included:

S2.1, the SDL engine parse the UDI instruction, obtain query interface and screening conditions；

S2.2, the SDL engine call query function according to the query interface and screening conditions, execute in the database Inquiry operation；

The data set that inquiry obtains is returned to the UDI terminal by S2.3, the SDL engine.

It is instructed specifically, UDI instruction is converted into data base querying by SDL, i.e., statistics industry is carried out to incoming post parameter Information of being engaged in and returns result to UDI terminal to the conversion of technical information；Such as statistics metadata is inquired, it can hold Row sdl.variable () function；Statistical data is inquired, sdl.data () function can be executed.It is described below respectively:

(1) query metadata (metadata refers to the data of descriptive statistics data, mainly describes the attribute of data), such as The following metadata in monthly data is inquired, " the general public budget income (hundred million yuan) in place ", " gross fixed assets investment (hundred million yuan) ", " total retail sales of consumer goods (hundred million yuan) ", " Consumer Prices index ", by calling sdl.variable () ?.

(2) inquire data (data are extracted by the metadata information of inquiry).For example, inquiry operating income is more than The total profit of 1000000 industrial enterprise.The statistical data query language of service-oriented be described as " variable=total profit, Operating income=1000000~, report classification=industry ", following sdl.data () function can be called:

Sdl.data (variable=" total profit, operating income ", operating income=" 1000000~", report classification=" Industry ").

The access way that S3, the UDI terminal are selected according to user, calls corresponding function, and the inquiry is obtained Data set exports as the data file of format corresponding with the access way of user selection.

Specifically, UDI terminal provides data file export function by using different functions, by the function by data The file of different-format (SAS, SPASS, mark's prestige etc.) is exported to, is carried out in each analysis tool meeting business personnel Operation.For example, going out associated data set in expanding packet using sdl.data () functional query, then can executing The data set inquired is exported as SAS file and CSV data file by sdl.exportSAS () function, or is executed The data set inquired is exported as spass file and CSV data file by sdl.exportSPASS () function, and is exported as The function of EXCEL format etc. sequence of operations, in order to be applied in each analysis tool.

The present invention also provides a kind of data query system of unified interface, which includes: UDI terminal and SDL engine；

The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by institute UDI instruction is stated to be passed in statistical data language SDL engine as post parameter；

The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will look into It askes obtained data set and returns to the UDI terminal；

The UDI terminal is also used to the access way selected according to user, calls corresponding function, inquire described To data set export as and the data file of the corresponding format of access way of user selection.

Optionally, in this embodiment, the SDL engine, is specifically used for:

The UDI instruction is parsed, query interface and screening conditions are obtained；

Query function is called according to the query interface and screening conditions, executes inquiry operation in the database；

The data set that inquiry obtains is returned into the UDI terminal.

UDI in the present invention is with International Statistical standard (DDI) for guiding theory, to metadata and data acquiring mode into It has gone effective encapsulation, has formed standard, unified data acquiring mode, to reduce analysis personnel when using UDI Access threshold.

UDI provides a kind of query language towards statistical service.It solves the problems, such as the access to different development language And shield the compatibility of data in different formats in query data repository library.

UDI is the channel of various technology platforms and development language access data warehouse, and the exploitation of UDI follows the HTTP of standard Agreement calls directly for a variety of development languages such as Java language, C language, R language.In addition, UDI provides the face of complete set To the statistical query language of business, data analyst only needs to understand that business can write out UDI instruction, is instructed by SDL The executable instruction of data warehouse is converted to, to reduce to analysis personnel's technical requirements.

UDI provides the expanding packet of R language and Python, i.e. UDI terminal, and terminal calls directly SDL to carry out industry Business data query and analysis.

UDI terminal constitutes the matched application tool system of data warehouse.By the construction of data application tool, shield The direct operation of statistical service personnel and external system to data warehouse, ensure that the Information Security of data warehouse；It is counting The UDI designed on service basic reduces the difficulty of statistical service personnel's operation data, allow more statistical service personnel according to The arbitrary data of need of work Flexible Query data warehouse, to be provided deeper into more fully development analysis of statistical data with utilization It ensures.

The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (8)

1. a kind of data query method of unified interface characterized by comprising

Step 1, when receive user terminal transmission uniform data query interface UDI instruction when, UDI terminal refers to the UDI It enables and being passed in statistical data language SDL engine as post parameter；

UDI instruction is converted into data base querying and instructs and execute inquiry operation by step 2, the SDL engine, will be inquired To data set return to the UDI terminal；

The access way that step 3, the UDI terminal are selected according to user, calls corresponding function, by the number inquired and obtained The data file of format corresponding with the access way of user selection is exported as according to collection.

2. the method according to claim 1, wherein the step 2 specifically includes:

Step 2.1, the SDL engine parse the UDI instruction, obtain query interface and screening conditions；

Step 2.2, the SDL engine call query function according to the query interface and screening conditions, execute in the database Inquiry operation；

The data set that inquiry obtains is returned to the UDI terminal by step 2.3, the SDL engine.

3. the method according to claim 1, wherein the UDI terminal supports the extension of R and Python Packet.

4. the method according to claim 1, wherein the UDI terminal follows standard HTTP exploitation.

5. a kind of data query system of unified interface characterized by comprising UDI terminal and SDL engine；

The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by the UDI Instruction is passed in statistical data language SDL engine as post parameter；

The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will inquire To data set return to the UDI terminal；

The UDI terminal is also used to the access way selected according to user, calls corresponding function, and the inquiry is obtained Data set exports as the data file of format corresponding with the access way of user selection.

6. system according to claim 5, which is characterized in that the SDL engine is specifically used for:

The UDI instruction is parsed, query interface and screening conditions are obtained；

Query function is called according to the query interface and screening conditions, executes inquiry operation in the database；

The data set that inquiry obtains is returned into the UDI terminal.

7. system according to claim 5, which is characterized in that the UDI terminal supports the extension of R and Python Packet.

8. system according to claim 5, which is characterized in that the UDI terminal follows standard HTTP exploitation.