CN104636502A - Accelerated data query method of query system - Google Patents
Accelerated data query method of query system Download PDFInfo
- Publication number
- CN104636502A CN104636502A CN201510103767.1A CN201510103767A CN104636502A CN 104636502 A CN104636502 A CN 104636502A CN 201510103767 A CN201510103767 A CN 201510103767A CN 104636502 A CN104636502 A CN 104636502A
- Authority
- CN
- China
- Prior art keywords
- data
- query
- file
- querying condition
- inquiry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses an accelerated data query method of a query system. The process of the fast query method is as follows: after receiving a user query request, the system firstly transfers the user query request to a query analyzer for analyzing query conditions and regulating the query conditions, then a file buffer is used for analyzing whether an existing result data file satisfies the current query conditions, if not, querying a database and sending back a final result file to a data processor, the data processor filters and sequences the data according to final query requirements and returns the result file to an upper layer application system for displaying the page. Compared with the prior art, the accelerated data query method of query system disclosed by the invention can greatly reduce the occupation of the data base and the system resources and greatly increase the query speed without increasing the hardware investment.
Description
Technical field
The present invention relates to computer data inquiring technology field, specifically a kind of data speedup query method of inquiry system.
Background technology
The development of society, enterprise carries out increasing building of supporting system, information sharing becomes particularly important, the shared calling party of software systems that makes of information increases, but along with being on the increase of user, the queries of data will inevitably increase greatly, and system will be more and more slower, thus needs to drop into the upgrading that more fund carries out equipment and software.Such reason is caused to be that each inquiry request of user, system is all by searching accordingly in a database, and the operations such as data calculating, then return result.The queries of user increases, and the data processing amount of system also linearly increases thereupon.
Summary of the invention
Technical assignment of the present invention is to provide a kind of data speedup query method of inquiry system.
Technical assignment of the present invention realizes in the following manner, this method for quickly querying process is as follows: after system receives user inquiry request, first forward query analyzer to, analysis and consult condition, and ruleization querying condition, then through archive buffer, analyze in existing result data files whether to exist and meet current queries condition, then do not inquire about from database, and final destination file is returned to data processor, data processor is according to final search request, data are filtered, sequence process, destination file is returned upper layer application system and carry out webpage representation.
The concrete steps of described method for quickly querying are as follows:
Step 1: the querying condition that analysis and consult is submitted to, is divided into the two large divisions of database operation process and data processor processes by querying condition; Database operation process is mainly to the extraction of data and the querying condition of logical calculated part; Data processor processes mainly comprises the operation such as filtration and sequence to result data;
Step 2: ruleization querying condition, is unified into the querying condition of standard by querying condition, avoid different on query specification and be actually same case;
Step 3: after forming unified querying condition, be sent in archive buffer, archive buffer first finds the historical data registration list of corresponding query case, in registration list, the history data file meeting conditions present is retrieved again according to querying condition, this index have recorded the querying condition of this query case historical data, query time, user, access times;
Step 4: according to the result of retrieval, judge whether all there is desired data file, forwards step 8 to if existed, otherwise forwards next step to;
Step 5: the querying condition after analyzing is inquired about in a database, the data file required for generation, and be stored in corresponding data directory;
Step 6: by the data file generated, be registered in the document retrieval list of archive buffer;
Step 7: the result data files numbering returning needs;
Step 8: according to the reference number of a document returned, obtains data file;
Step 9: data processor processes the data file that data return, restores the data query of needs from destination file; And by some querying conditions, original needs transfers to data processor processes in the computing of database;
Step 10: according to fixing storage structure, final result data is returned to upper layer application system and carries out webpage representation, process terminates.
In described step 2, ruleization querying condition comprises set judgement merging: convert the condition of small set to big collection; Querying condition sorts: arranged in a fixed order by querying condition, adopts the sequencing of character; System can carry out the arrangement of unified order, makes it become an identical querying condition.
In described step 3, in order to improve the hit rate of inquiry file impact damper retrieve data file, system adopts following search mechanism:
1) from complete or collected works' data, the data of subset are obtained: if will inquire about several subsets, and these several subsets belong to an another one complete or collected works' part just, and system will return this data file;
2) part subset is searched: if will inquire about several subsets, and these several subsets only have part to be retrieved, and so system can arrive step 5, only generates the part subset do not had;
In order to improve archive buffer effectiveness of retrieval, system adopts following mechanism:
1) adopt according to the storage of query case sectional lists, system can form a file buffering catalogue for each query case automatically, and each catalogue has an index, and each inquiry only goes to retrieve corresponding index;
2) historical data of exceeding the time limit is deleted, and system can will exceed retention cycle and the low file erase of frequency of utilization, thus reduces the size of file buffering list;
3) Query Result file polymerization, becomes complete or collected works' file by multiple subset Piece file mergence.
In described step 9, data processor processes the data file that data return and is made up of following concrete steps:
1) choose the data acquisition required for inquiry, from universal class, filter out the subset data of needs or multiple subset data is merged, being merged into required data set;
2) display column required for inquiry is chosen;
3) sort result, sorts to result data according to the requirement of inquiry.
The data speedup query method of a kind of inquiry system of the present invention compared to the prior art, by historical query data are preserved, utilize historical query data as query caching data, thus repetition inquiry request can be avoided, system process repeatedly, system can not be increased along with the queries of user, and data processing amount also linearly increases thereupon; But also historical results data can be utilized, the inquiry of expedited data, improve the efficiency of system cloud gray model, reduce the average response time of user, reduce the reason such as use increase because of user, and the software and hardware upgrade carried out, save substantial contribution.
Accompanying drawing explanation
Accompanying drawing 1 is a kind of FB(flow block) of data speedup query method of inquiry system;
Accompanying drawing 2 is a kind of concrete steps schematic flow sheet of data speedup query method of inquiry system;
Accompanying drawing 3 is the inquiry system treatment step FB(flow block) of general form.
Accompanying drawing 4 is the query steps FB(flow block) based on the form of the data speedup query method of inquiry system of the present invention in embodiment 2.
Embodiment
Embodiment 1:
This method for quickly querying process is as follows: after system receives user inquiry request, first forward query analyzer to, analysis and consult condition, and ruleization querying condition, then through archive buffer, analyze in existing result data files whether to exist and meet current queries condition, then do not inquire about from database, and final destination file is returned to data processor, data processor is according to final search request, data are filtered, process of sorting, destination file is returned upper layer application system and carries out webpage representation.
The concrete steps of described method for quickly querying are as follows:
Step 1: the querying condition that analysis and consult is submitted to, is divided into the two large divisions of database operation process and data processor processes by querying condition; Database operation process is mainly to the extraction of data and the querying condition of logical calculated part; Data processor processes mainly comprises the operation such as filtration and sequence to result data;
Step 2: ruleization querying condition, is unified into the querying condition of standard by querying condition, avoid different on query specification and be actually same case;
Ruleization querying condition comprises set and judges to merge: convert the condition of small set to big collection; Querying condition sorts: arranged in a fixed order by querying condition, adopts the sequencing of character; System can carry out the arrangement of unified order, makes it become an identical querying condition;
Step 3: after forming unified querying condition, be sent in archive buffer, archive buffer first finds the historical data registration list of corresponding query case, in registration list, the history data file meeting conditions present is retrieved again according to querying condition, this index have recorded the querying condition of this query case historical data, query time, user, access times;
In order to improve the hit rate of inquiry file impact damper retrieve data file, system adopts following search mechanism:
1) from complete or collected works' data, the data of subset are obtained: if will inquire about several subsets, and these several subsets belong to an another one complete or collected works' part just, and system will return this data file;
2) part subset is searched: if will inquire about several subsets, and these several subsets only have part to be retrieved, and so system can arrive step 5, only generates the part subset do not had;
In order to improve archive buffer effectiveness of retrieval, system adopts following mechanism:
1) adopt according to the storage of query case sectional lists, system can form a file buffering catalogue for each query case automatically, and each catalogue has an index, and each inquiry only goes to retrieve corresponding index;
2) historical data of exceeding the time limit is deleted, and system can will exceed retention cycle and the low file erase of frequency of utilization, thus reduces the size of file buffering list;
3) Query Result file polymerization, becomes complete or collected works' file by multiple subset Piece file mergence;
Step 4: according to the result of retrieval, judge whether all there is desired data file, forwards step 8 to if existed, otherwise forwards next step to;
Step 5: the querying condition after analyzing is inquired about in a database, the data file required for generation, and be stored in corresponding data directory;
Step 6: by the data file generated, be registered in the document retrieval list of archive buffer;
Step 7: the result data files numbering returning needs;
Step 8: according to the reference number of a document returned, obtains data file;
Step 9: data processor processes the data file that data return, restores the data query of needs from destination file; And by some querying conditions, original needs transfers to data processor processes in the computing of database;
Data processor processes the data file that data return and is made up of following concrete steps:
1) choose the data acquisition required for inquiry, from universal class, filter out the subset data of needs or multiple subset data is merged, being merged into required data set;
2) display column required for inquiry is chosen;
3) sort result, sorts to result data according to the requirement of inquiry;
Step 10: according to fixing storage structure, final result data is returned to upper layer application system and carries out webpage representation, process terminates.
Embodiment 2:
Such as the report query of performance system, concrete execution step is as follows:
Step 1: user inquires about form A, sets from the page condition submit Query request that will inquire about.
Step 2: inquiry request is forwarded to query analyzer, starts to analyze the querying condition submitted to, inquiry is divided into the two large divisions of database operation process and data processor processes.
Step 3: ruleization querying condition, is unified into the querying condition of standard by querying condition, avoid different on some query specification and be actually same case, and sorting according to alphabetical sequencing to querying condition.
Step 4: after forming unified querying condition, be sent in archive buffer, archive buffer, according to the ID that will inquire about form A, finds historical data registration list under finding corresponding catalogue, according to the history data file meeting conditions present in querying condition retrieval registration list.
Step 5: according to retrieving the result returned, showing that required destination file only has part to exist, inquiry request is forwarded.
Step 6: the data file querying condition after analysis being generated standard format, and be stored in the data buffering catalogue of corresponding form A.
Step 7: by the data file generated, be registered in the document retrieval list of archive buffer.
Step 8: the result data files numbering returning registration.
Step 9: according to the reference number of a document returned, obtains data file.
Step 10: data processor processes the data file that data return.From destination file, filter out the data acquisition of needs, then sort according to the descending of row.In general it is larger for inquiring about selected source data amount, and the result data amount dealt is very little, and therefore filter result data and the operation such as arrangement, the processing time of cost can be ignored.
Step 11: according to fixing storage structure, final result data is returned to upper layer application, and carry out report form showing, feed back to user, process terminates.
By embodiment above, described those skilled in the art can be easy to realize the present invention.But should be appreciated that the present invention is not limited to above-mentioned several embodiments.On the basis of disclosed embodiment, described those skilled in the art can the different technical characteristic of combination in any, thus realizes different technical schemes.
Claims (5)
1. the data speedup query method of an inquiry system, it is characterized in that, this method for quickly querying process is as follows: after system receives user inquiry request, first forward query analyzer to, analysis and consult condition, and ruleization querying condition, then through archive buffer, analyze in existing result data files whether to exist and meet current queries condition, then do not inquire about from database, and final destination file is returned to data processor, data processor is according to final search request, data are filtered, sequence process, destination file is returned upper layer application system and carry out webpage representation.
2. the data speedup query method of a kind of inquiry system according to claim 1, is characterized in that, the concrete steps of described method for quickly querying are as follows:
Step 1: the querying condition that analysis and consult is submitted to, is divided into the two large divisions of database operation process and data processor processes by querying condition; Database operation process is mainly to the extraction of data and the querying condition of logical calculated part; Data processor processes mainly comprises the operation such as filtration and sequence to result data;
Step 2: ruleization querying condition, is unified into the querying condition of standard by querying condition, avoid different on query specification and be actually same case;
Step 3: after forming unified querying condition, be sent in archive buffer, archive buffer first finds the historical data registration list of corresponding query case, in registration list, the history data file meeting conditions present is retrieved again according to querying condition, this index have recorded the querying condition of this query case historical data, query time, user, access times;
Step 4: according to the result of retrieval, judge whether all there is desired data file, forwards step 8 to if existed, otherwise forwards next step to;
Step 5: the querying condition after analyzing is inquired about in a database, the data file required for generation, and be stored in corresponding data directory;
Step 6: by the data file generated, be registered in the document retrieval list of archive buffer;
Step 7: the result data files numbering returning needs;
Step 8: according to the reference number of a document returned, obtains data file;
Step 9: data processor processes the data file that data return, restores the data query of needs from destination file; And by some querying conditions, original needs transfers to data processor processes in the computing of database;
Step 10: according to fixing storage structure, final result data is returned to upper layer application system and carries out webpage representation, process terminates.
3. the data speedup query method of a kind of inquiry system according to claim 2, is characterized in that, in described step 2, ruleization querying condition comprises set judgement merging: convert the condition of small set to big collection; Querying condition sorts: arranged in a fixed order by querying condition, adopts the sequencing of character; System can carry out the arrangement of unified order, makes it become an identical querying condition.
4. the data speedup query method of a kind of inquiry system according to claim 2, is characterized in that, in described step 3, in order to improve the hit rate of inquiry file impact damper retrieve data file, system adopts following search mechanism:
1) from complete or collected works' data, the data of subset are obtained: if will inquire about several subsets, and these several subsets belong to an another one complete or collected works' part just, and system will return this data file;
2) part subset is searched: if will inquire about several subsets, and these several subsets only have part to be retrieved, and so system can arrive step 5, only generates the part subset do not had;
In order to improve archive buffer effectiveness of retrieval, system adopts following mechanism:
1) adopt according to the storage of query case sectional lists, system can form a file buffering catalogue for each query case automatically, and each catalogue has an index, and each inquiry only goes to retrieve corresponding index;
2) historical data of exceeding the time limit is deleted, and system can will exceed retention cycle and the low file erase of frequency of utilization, thus reduces the size of file buffering list;
3) Query Result file polymerization, becomes complete or collected works' file by multiple subset Piece file mergence.
5. the data speedup query method of a kind of inquiry system according to claim 2, is characterized in that, in described step 9, data processor processes the data file that data return and is made up of following concrete steps:
1) choose the data acquisition required for inquiry, from universal class, filter out the subset data of needs or multiple subset data is merged, being merged into required data set;
2) display column required for inquiry is chosen;
3) sort result, sorts to result data according to the requirement of inquiry.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510103767.1A CN104636502A (en) | 2015-03-10 | 2015-03-10 | Accelerated data query method of query system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510103767.1A CN104636502A (en) | 2015-03-10 | 2015-03-10 | Accelerated data query method of query system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104636502A true CN104636502A (en) | 2015-05-20 |
Family
ID=53215247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510103767.1A Pending CN104636502A (en) | 2015-03-10 | 2015-03-10 | Accelerated data query method of query system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104636502A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105630997A (en) * | 2015-12-24 | 2016-06-01 | 广州精点计算机科技有限公司 | Data parallel processing method, device and equipment |
| CN105653646A (en) * | 2015-12-28 | 2016-06-08 | 北京中电普华信息技术有限公司 | Dynamic query system and method under concurrent query condition |
| CN106385428A (en) * | 2015-09-15 | 2017-02-08 | 山东华平信息科技有限公司 | Page processing method based on medical health cloud platform and cloud platform |
| CN106777147A (en) * | 2016-12-19 | 2017-05-31 | 中航（重庆）微电子有限公司 | A kind of optimization method of spot database |
| CN108733697A (en) * | 2017-04-19 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus for executing data query |
| CN109189800A (en) * | 2018-08-16 | 2019-01-11 | 北京中科梧桐网络科技有限公司 | A kind of data Layer paging query model and querying method |
| CN109241766A (en) * | 2018-07-27 | 2019-01-18 | 至本医疗科技（上海）有限公司 | A kind of method and apparatus of data access control |
| CN109242463A (en) * | 2018-07-17 | 2019-01-18 | 华润物业工程科技有限公司 | House charging configures system |
| CN111949857A (en) * | 2020-08-13 | 2020-11-17 | 中国民航信息网络股份有限公司 | Flight query request processing method and device and electronic equipment |
| CN113486048A (en) * | 2021-07-13 | 2021-10-08 | 广西电力职业技术学院 | Data retrieval system and data retrieval method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1758248A (en) * | 2004-10-05 | 2006-04-12 | 微软公司 | Systems, methods, and interfaces for providing personalized search and information access |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
| CN101312457A (en) * | 2002-03-28 | 2008-11-26 | 普里凯许公司 | Method, router, apparatus and the network used in a publish-subscribe network |
-
2015
- 2015-03-10 CN CN201510103767.1A patent/CN104636502A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101312457A (en) * | 2002-03-28 | 2008-11-26 | 普里凯许公司 | Method, router, apparatus and the network used in a publish-subscribe network |
| CN1758248A (en) * | 2004-10-05 | 2006-04-12 | 微软公司 | Systems, methods, and interfaces for providing personalized search and information access |
| CN101110074A (en) * | 2007-01-30 | 2008-01-23 | 浪潮乐金信息系统有限公司 | Data speedup query method based on file system caching |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106385428A (en) * | 2015-09-15 | 2017-02-08 | 山东华平信息科技有限公司 | Page processing method based on medical health cloud platform and cloud platform |
| CN106385428B (en) * | 2015-09-15 | 2019-12-13 | 山东华平信息科技有限公司 | page processing method based on medical health cloud platform and cloud platform |
| CN105630997A (en) * | 2015-12-24 | 2016-06-01 | 广州精点计算机科技有限公司 | Data parallel processing method, device and equipment |
| CN105653646A (en) * | 2015-12-28 | 2016-06-08 | 北京中电普华信息技术有限公司 | Dynamic query system and method under concurrent query condition |
| CN105653646B (en) * | 2015-12-28 | 2019-06-04 | 北京中电普华信息技术有限公司 | System for dynamically querying and method under a kind of concurrent querying condition |
| CN106777147A (en) * | 2016-12-19 | 2017-05-31 | 中航（重庆）微电子有限公司 | A kind of optimization method of spot database |
| CN108733697A (en) * | 2017-04-19 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus for executing data query |
| CN109242463A (en) * | 2018-07-17 | 2019-01-18 | 华润物业工程科技有限公司 | House charging configures system |
| CN109241766A (en) * | 2018-07-27 | 2019-01-18 | 至本医疗科技（上海）有限公司 | A kind of method and apparatus of data access control |
| CN109189800A (en) * | 2018-08-16 | 2019-01-11 | 北京中科梧桐网络科技有限公司 | A kind of data Layer paging query model and querying method |
| CN111949857A (en) * | 2020-08-13 | 2020-11-17 | 中国民航信息网络股份有限公司 | Flight query request processing method and device and electronic equipment |
| CN113486048A (en) * | 2021-07-13 | 2021-10-08 | 广西电力职业技术学院 | Data retrieval system and data retrieval method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104636502A (en) | Accelerated data query method of query system | |
| CN100485689C (en) | Data speedup query method based on file system caching | |
| US9195698B2 (en) | Selectively retrieving search results in accordance with different logical relationships | |
| KR100971863B1 (en) | System and method for batched indexing of network documents | |
| US8108380B2 (en) | Inclusion of metadata in indexed composite document | |
| CN107783985B (en) | Distributed database query method, device and management system | |
| CN104268295B (en) | A kind of data query method and device | |
| CN102402605A (en) | Mixed distribution model for search engine indexing | |
| CN106156088B (en) | Index data processing method, data query method and device | |
| CN104239377A (en) | Platform-crossing data retrieval method and device | |
| CN104063376A (en) | Multi-dimensional grouping operation method and system | |
| CN113407785B (en) | Data processing method and system based on distributed storage system | |
| US10990573B2 (en) | Fast index creation system for cloud big data database | |
| CN102968464A (en) | Index-based local resource quick retrieval system and retrieval method thereof | |
| CN110647542B (en) | Data acquisition method and device | |
| CN103902592A (en) | Method and system for realizing analytic functions based on MapReduce | |
| CN115145871A (en) | File query method and device and electronic equipment | |
| CN103279529A (en) | Unstructured data retrieval method and system | |
| CN112445833A (en) | Data paging query method, device and system for distributed database | |
| CN110825953B (en) | Data query method, device and equipment | |
| CN110442614B (en) | Metadata searching method and device, electronic equipment and storage medium | |
| CN115576899B (en) | Index construction method and device and file searching method and device | |
| CN102622354B (en) | Aggregated data quick searching method based on feature vector | |
| CN111159213A (en) | Data query method, device, system and storage medium | |
| KR101375684B1 (en) | Method and system for managing dna sequence data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150520 |
|
| WD01 | Invention patent application deemed withdrawn after publication |