CN109542954A - A kind of data query method and system of unified interface - Google Patents
A kind of data query method and system of unified interface Download PDFInfo
- Publication number
- CN109542954A CN109542954A CN201811453009.2A CN201811453009A CN109542954A CN 109542954 A CN109542954 A CN 109542954A CN 201811453009 A CN201811453009 A CN 201811453009A CN 109542954 A CN109542954 A CN 109542954A
- Authority
- CN
- China
- Prior art keywords
- udi
- data
- terminal
- sdl
- engine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of data query method and system of unified interface, this method comprises: UDI instruction is passed in SDL engine by UDI terminal as post parameter when receiving UDI instruction;UDI instruction is converted into data base querying and instructs and execute inquiry operation by SDL engine, and the data set that inquiry obtains is returned to UDI terminal;The access way that UDI terminal is selected according to user calls corresponding function, and the data set that inquiry obtains is exported as to the data file of format corresponding with the access way of user's selection.The present invention passes through the construction of data application tool, shields the direct operation of statistical service personnel and external system to data warehouse, ensure that the Information Security of data warehouse;The UDI designed on the basis of statistical service reduces the difficulty of statistical service personnel's operation data;Shield the compatibility of data in different formats in query data repository library.
Description
Technical field
The present invention relates to statistical analysis fields, and in particular to a kind of data query method and system of unified interface.
Background technique
With the development of big data, data mining the relevant technologies, more and more people notice hidden under big data it is huge
Big economic value, therefore various analysis of statistical data tools emerge one after another.Such as R, Python, SAS, SPSS,
Tableau, Stata, EViews, mark's prestige etc..The worker for being engaged in big data analysis not only needs to be grasped relevant business and knows
Know, it is also necessary to corresponding data statistic analysis tool have it is certain grasp and understand, this proposes analysis personnel very high
It is required that.There may be following predicaments when data statistics business personnel states analysis tool in use at present:
(1) business personnel needs to be grasped a variety of analysis tools and its corresponding data manipulation mode;
(2) business personnel directly operates data warehouse when inquiring data, it is difficult to guarantee the safety of data warehouse
Property;
(3) analysis personnel cannot the effective operation data in the way of statistical service.
Summary of the invention
In view of the above technical problems, the present invention provides a kind of data query method and system of unified interface.
The technical scheme to solve the above technical problems is that a kind of data query method of unified interface, comprising:
Step 1, when receiving the uniform data query interface UDI instruction of user terminal transmission, UDI terminal will be described
UDI instruction is passed in statistical data language SDL engine as post parameter;
UDI instruction is converted into data base querying and instructs and execute inquiry operation by step 2, the SDL engine, will be looked into
It askes obtained data set and returns to the UDI terminal;
The access way that step 3, the UDI terminal are selected according to user, calls corresponding function, and the inquiry is obtained
Data set export as and the data file of the corresponding format of access way of user selection.
For achieving the above object, the present invention also provides a kind of data query systems of unified interface, comprising: UDI is whole
End and SDL engine;
The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by institute
UDI instruction is stated to be passed in statistical data language SDL engine as post parameter;
The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will look into
It askes obtained data set and returns to the UDI terminal;
The UDI terminal is also used to the access way selected according to user, calls corresponding function, inquire described
To data set export as and the data file of the corresponding format of access way of user selection.
The beneficial effects of the present invention are: constituting the data that data warehouse is matched, is made of UDI terminal and SDL engine
Application tool system shields statistical service personnel and external system to data warehouse by the construction of data application tool
It directly operates, ensure that the Information Security of data warehouse;The UDI terminal designed on the basis of statistical service, reduces statistics
The difficulty of business personnel's operation data;Data file is exported by calling function corresponding with selected access way, is shielded
The compatibility for having covered data in different formats in query data repository library allows more statistical service personnel flexibly to be looked into according to need of work
The arbitrary data of data warehouse is ask, to provide guarantee deeper into more fully development analysis of statistical data and utilization.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the data query method of unified interface provided in an embodiment of the present invention.
Specific embodiment
The principle and features of the present invention will be described below with reference to the accompanying drawings, and the given examples are served only to explain the present invention, and
It is non-to be used to limit the scope of the invention.
Fig. 1 is a kind of flow chart of the data query method of unified interface provided in an embodiment of the present invention, as shown in Figure 1,
This method comprises:
S1, when receive user terminal transmission uniform data query interface UDI instruction when, UDI terminal refers to the UDI
It enables and being passed in statistical data language SDL engine as post parameter;
Specifically, UDI (unified data interface, uniform data query interface) can provide based on R and
The expanding packet of Python, the function that R or Python expanding packet provides both had followed the grammer of R or Python, and towards industry
The statistical data language of business, the function that business analyst directly can use expanding packet to provide in R and Python terminal
Carry out data analysis.Expanding packet provides data and metadata query function abundant.Such as it is to the function of data query
Sdl.data (), the parameter of the function are the query interface and screening conditions for arbitrarily meeting statistical service theory.Third party's access
When only need to call fixed API, and the description of statistical data query language is passed to SDL (Statistics as post parameter
Data Language, statistical data language) engine.
UDI instruction is converted into data base querying and instructs and execute inquiry operation by S2, the SDL engine, will be inquired
Obtained data set returns to the UDI terminal;
Optionally, in this embodiment, step S2 is specifically included:
S2.1, the SDL engine parse the UDI instruction, obtain query interface and screening conditions;
S2.2, the SDL engine call query function according to the query interface and screening conditions, execute in the database
Inquiry operation;
The data set that inquiry obtains is returned to the UDI terminal by S2.3, the SDL engine.
It is instructed specifically, UDI instruction is converted into data base querying by SDL, i.e., statistics industry is carried out to incoming post parameter
Information of being engaged in and returns result to UDI terminal to the conversion of technical information;Such as statistics metadata is inquired, it can hold
Row sdl.variable () function;Statistical data is inquired, sdl.data () function can be executed.It is described below respectively:
(1) query metadata (metadata refers to the data of descriptive statistics data, mainly describes the attribute of data), such as
The following metadata in monthly data is inquired, " the general public budget income (hundred million yuan) in place ", " gross fixed assets investment
(hundred million yuan) ", " total retail sales of consumer goods (hundred million yuan) ", " Consumer Prices index ", by calling sdl.variable ()
?.
(2) inquire data (data are extracted by the metadata information of inquiry).For example, inquiry operating income is more than
The total profit of 1000000 industrial enterprise.The statistical data query language of service-oriented be described as " variable=total profit,
Operating income=1000000~, report classification=industry ", following sdl.data () function can be called:
Sdl.data (variable=" total profit, operating income ", operating income=" 1000000~", report classification="
Industry ").
The access way that S3, the UDI terminal are selected according to user, calls corresponding function, and the inquiry is obtained
Data set exports as the data file of format corresponding with the access way of user selection.
Specifically, UDI terminal provides data file export function by using different functions, by the function by data
The file of different-format (SAS, SPASS, mark's prestige etc.) is exported to, is carried out in each analysis tool meeting business personnel
Operation.For example, going out associated data set in expanding packet using sdl.data () functional query, then can executing
The data set inquired is exported as SAS file and CSV data file by sdl.exportSAS () function, or is executed
The data set inquired is exported as spass file and CSV data file by sdl.exportSPASS () function, and is exported as
The function of EXCEL format etc. sequence of operations, in order to be applied in each analysis tool.
The present invention also provides a kind of data query system of unified interface, which includes: UDI terminal and SDL engine;
The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by institute
UDI instruction is stated to be passed in statistical data language SDL engine as post parameter;
The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will look into
It askes obtained data set and returns to the UDI terminal;
The UDI terminal is also used to the access way selected according to user, calls corresponding function, inquire described
To data set export as and the data file of the corresponding format of access way of user selection.
Optionally, in this embodiment, the SDL engine, is specifically used for:
The UDI instruction is parsed, query interface and screening conditions are obtained;
Query function is called according to the query interface and screening conditions, executes inquiry operation in the database;
The data set that inquiry obtains is returned into the UDI terminal.
UDI in the present invention is with International Statistical standard (DDI) for guiding theory, to metadata and data acquiring mode into
It has gone effective encapsulation, has formed standard, unified data acquiring mode, to reduce analysis personnel when using UDI
Access threshold.
UDI provides a kind of query language towards statistical service.It solves the problems, such as the access to different development language
And shield the compatibility of data in different formats in query data repository library.
UDI is the channel of various technology platforms and development language access data warehouse, and the exploitation of UDI follows the HTTP of standard
Agreement calls directly for a variety of development languages such as Java language, C language, R language.In addition, UDI provides the face of complete set
To the statistical query language of business, data analyst only needs to understand that business can write out UDI instruction, is instructed by SDL
The executable instruction of data warehouse is converted to, to reduce to analysis personnel's technical requirements.
UDI provides the expanding packet of R language and Python, i.e. UDI terminal, and terminal calls directly SDL to carry out industry
Business data query and analysis.
UDI terminal constitutes the matched application tool system of data warehouse.By the construction of data application tool, shield
The direct operation of statistical service personnel and external system to data warehouse, ensure that the Information Security of data warehouse;It is counting
The UDI designed on service basic reduces the difficulty of statistical service personnel's operation data, allow more statistical service personnel according to
The arbitrary data of need of work Flexible Query data warehouse, to be provided deeper into more fully development analysis of statistical data with utilization
It ensures.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (8)
1. a kind of data query method of unified interface characterized by comprising
Step 1, when receive user terminal transmission uniform data query interface UDI instruction when, UDI terminal refers to the UDI
It enables and being passed in statistical data language SDL engine as post parameter;
UDI instruction is converted into data base querying and instructs and execute inquiry operation by step 2, the SDL engine, will be inquired
To data set return to the UDI terminal;
The access way that step 3, the UDI terminal are selected according to user, calls corresponding function, by the number inquired and obtained
The data file of format corresponding with the access way of user selection is exported as according to collection.
2. the method according to claim 1, wherein the step 2 specifically includes:
Step 2.1, the SDL engine parse the UDI instruction, obtain query interface and screening conditions;
Step 2.2, the SDL engine call query function according to the query interface and screening conditions, execute in the database
Inquiry operation;
The data set that inquiry obtains is returned to the UDI terminal by step 2.3, the SDL engine.
3. the method according to claim 1, wherein the UDI terminal supports the extension of R and Python
Packet.
4. the method according to claim 1, wherein the UDI terminal follows standard HTTP exploitation.
5. a kind of data query system of unified interface characterized by comprising UDI terminal and SDL engine;
The UDI terminal, for when receive user terminal transmission uniform data query interface UDI instruction when, by the UDI
Instruction is passed in statistical data language SDL engine as post parameter;
The SDL engine instructs and executes inquiry operation for UDI instruction to be converted into data base querying, will inquire
To data set return to the UDI terminal;
The UDI terminal is also used to the access way selected according to user, calls corresponding function, and the inquiry is obtained
Data set exports as the data file of format corresponding with the access way of user selection.
6. system according to claim 5, which is characterized in that the SDL engine is specifically used for:
The UDI instruction is parsed, query interface and screening conditions are obtained;
Query function is called according to the query interface and screening conditions, executes inquiry operation in the database;
The data set that inquiry obtains is returned into the UDI terminal.
7. system according to claim 5, which is characterized in that the UDI terminal supports the extension of R and Python
Packet.
8. system according to claim 5, which is characterized in that the UDI terminal follows standard HTTP exploitation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811453009.2A CN109542954A (en) | 2018-11-30 | 2018-11-30 | A kind of data query method and system of unified interface |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811453009.2A CN109542954A (en) | 2018-11-30 | 2018-11-30 | A kind of data query method and system of unified interface |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109542954A true CN109542954A (en) | 2019-03-29 |
Family
ID=65851491
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811453009.2A Pending CN109542954A (en) | 2018-11-30 | 2018-11-30 | A kind of data query method and system of unified interface |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109542954A (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104537496A (en) * | 2014-12-30 | 2015-04-22 | 广州视睿电子科技有限公司 | Intelligent terminal device use condition statistical analysis method and device |
CN105224613A (en) * | 2015-09-17 | 2016-01-06 | 西安未来国际信息股份有限公司 | Based on integrating heterogeneous data source system and the integration method thereof of the federal technology of data |
CN106407111A (en) * | 2016-09-07 | 2017-02-15 | 努比亚技术有限公司 | Terminal test apparatus, terminal test device and variable maintenance method |
CN107832391A (en) * | 2017-10-31 | 2018-03-23 | 长城计算机软件与系统有限公司 | A kind of data query method and system |
CN108170718A (en) * | 2017-12-05 | 2018-06-15 | 北京先进数通信息技术股份公司 | A kind for the treatment of method and apparatus of achievement data |
-
2018
- 2018-11-30 CN CN201811453009.2A patent/CN109542954A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104537496A (en) * | 2014-12-30 | 2015-04-22 | 广州视睿电子科技有限公司 | Intelligent terminal device use condition statistical analysis method and device |
CN105224613A (en) * | 2015-09-17 | 2016-01-06 | 西安未来国际信息股份有限公司 | Based on integrating heterogeneous data source system and the integration method thereof of the federal technology of data |
CN106407111A (en) * | 2016-09-07 | 2017-02-15 | 努比亚技术有限公司 | Terminal test apparatus, terminal test device and variable maintenance method |
CN107832391A (en) * | 2017-10-31 | 2018-03-23 | 长城计算机软件与系统有限公司 | A kind of data query method and system |
CN108170718A (en) * | 2017-12-05 | 2018-06-15 | 北京先进数通信息技术股份公司 | A kind for the treatment of method and apparatus of achievement data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10515094B2 (en) | System and method for analyzing and reporting extensible data from multiple sources in multiple formats | |
US8666968B2 (en) | Executing runtime callback functions | |
US8463811B2 (en) | Automated correlation discovery for semi-structured processes | |
CN101872449A (en) | Customer information screening method | |
CN103605651A (en) | Data processing showing method based on on-line analytical processing (OLAP) multi-dimensional analysis | |
Baškarada | How spreadsheet applications affect information quality | |
CN104978312A (en) | Method using stock code to retrieve patent information | |
CN101388036A (en) | Data table summarizing method and device | |
CN115577386A (en) | Enterprise credit increase service method and system based on XBRL and block chain | |
US20080114727A1 (en) | Universal statistical data mining component | |
CN109542954A (en) | A kind of data query method and system of unified interface | |
CN102819542A (en) | Method and device for presenting instance documents | |
CN111126946B (en) | Modeling method and device for data tracing of informatization system | |
KR101433139B1 (en) | Data Preprocessing System For Process Analysis | |
CN114596044A (en) | Tool and method for project process approval | |
CN110781520A (en) | Sensitive table group discovery method and system | |
CN103559586B (en) | A kind of report document management, system and method | |
CN105429779B (en) | A kind of network service data automatic identification system and method | |
CN105225124A (en) | Novel mobile client management platform | |
CN103455495A (en) | Enterprise business identifier data encoding method and device | |
CN105117821A (en) | Industrial control system information safety asset identifying method based on area division | |
CN204155315U (en) | Novel mobile client management devices | |
KR102346289B1 (en) | Method and system for retrieving statistics and original data in structured language from open source big data system | |
KR101285115B1 (en) | System and method for providing linked contents using tag | |
US20100185603A1 (en) | Techniques for using database rule results |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190329 |