CN110046163A - A kind of data retrieval method and system - Google Patents
A kind of data retrieval method and system Download PDFInfo
- Publication number
- CN110046163A CN110046163A CN201910294057.XA CN201910294057A CN110046163A CN 110046163 A CN110046163 A CN 110046163A CN 201910294057 A CN201910294057 A CN 201910294057A CN 110046163 A CN110046163 A CN 110046163A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- retrieved
- sentence
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of data retrieval method and systems, this method comprises: receiving retrieval request, wherein the retrieval request includes the corresponding metadata title of data to be retrieved；Storage information according to the pre-stored data and the metadata title determine the type for storing the database of the data to be retrieved；The primary sentence that the type database is able to carry out is converted by the retrieval request according to the type of the database；The data to be retrieved are obtained from the database using the primary sentence.It can be improved the convenience of data retrieval using scheme provided by the invention, reduce the difficulty that business personnel carries out data retrieval.
Description
Technical field
The present invention relates to computer application technology, in particular to a kind of data retrieval method and system.
Background technique
With the fast development of Internet technology, big data acceptance, technology, using etc. various aspects tend to be mature,
Start the Rapid development stage for the industry of stepping into, the huge application value of big data has driven the rapid development of big data industry.
Current big data storage mode is varied, and different storage modes respectively has when facing different business scenarios
Each advantage exists.For example, for the business scenario for needing to analyze the big data obtained in real time, in order to meet big data
Big data can be stored in Hbase database by the real-time of analysis.However different storage modes can all be corresponding with difference
Query grammar, different database table structures, different field type etc., this is allowed in the retrieval for needing to carry out big data
When, it needs business personnel to require a great deal of time and learns to grasp the inquiry language of used storage mode with practice
Method, database table structure and field type etc., to increase the difficulty of big data retrieval.
Summary of the invention
In order to solve problems in the prior art, the embodiment of the invention provides a kind of data retrieval method and systems.
The technical solution is as follows:
In a first aspect, providing a kind of data retrieval method, which comprises
Receive retrieval request, wherein the retrieval request includes the corresponding metadata title of data to be retrieved；
Storage information according to the pre-stored data and the metadata title determine the database for storing the data to be retrieved
Type；
The primary language that the type database is able to carry out is converted by the retrieval request according to the type of the database
Sentence；
The data to be retrieved are obtained from the database using the primary sentence.
Optionally, the type according to the database converts the type database for the retrieval request and can hold
The step of capable primary sentence, comprising:
Obtain the power of the corresponding each indexing parameter of each database, each storage parameter and each performance parameter
Value and contribution degree；
For each database, it is weighted to obtain the comprehensive of the database to the weight and contribution degree
Point；
The primary sentence that the highest database of the comprehensive score is able to carry out is converted by the retrieval request.
Optionally, described the step of obtaining the data to be retrieved from the database using the primary sentence, packet
It includes:
The data to be retrieved are obtained from the highest database of comprehensive score using the primary sentence.
Optionally, the indexing parameter includes: index type and index radix；
The storage parameter includes: library table size, library table row number, library table columns and time granularity；
The performance parameter includes: average IO and the average load of database of database.
Optionally, the storage information, further includes: for storing the partition information of the data to be retrieved and for looking into
Look for the index information of the data to be retrieved.
Optionally, the retrieval request also includes: the processing sentence handled the data retrieved, the processing language
Sentence includes: for the data retrieved to be carried out with the statistics sentence of statistical disposition, is filtered processing to the data retrieved
Filtering sentence and the custom variable that the data retrieved are carried out with customized processing；
Described the step of obtaining the data to be retrieved from the database using the primary sentence, comprising:
The primary sentence is sent to the database, it is corresponding with the metadata title from the database lookup
Data, the data found handle according to the processing sentence and will treated data as described to be retrieved
Data.
Optionally, it is described using the primary sentence obtain the data to be retrieved from the database the step of it
Afterwards, further includes:
The data to be retrieved are resolved into scheduled format.
Second aspect provides a kind of data retrieval system, including
Receiving module, for receiving retrieval request, wherein the retrieval request includes the corresponding metadata of data to be retrieved
Title；
Memory module is used for storage information according to the pre-stored data and the metadata title, determines that storage is described to be checked
The type of the database of rope data；
Conversion module, converting the type database for the retrieval request for the type according to the database can
The primary sentence executed；
Module is obtained, for obtaining the data to be retrieved from the database using the primary sentence.
Optionally, the conversion module is also used to obtain the corresponding each indexing parameter of each database, Mei Yicun
Store up the weight and contribution degree of parameter and each performance parameter；
For each database, it is weighted to obtain the comprehensive of the database to the weight and contribution degree
Point；
The primary sentence that the highest database of the comprehensive score is able to carry out is converted by the retrieval request.
Optionally, the acquisition module is also used to obtain from the highest database of comprehensive score using the primary sentence
Obtain the data to be retrieved.
Optionally, the indexing parameter includes: index type and index radix；
The storage parameter includes: library table size, library table row number, library table columns and time granularity；
The performance parameter includes: average IO and the average load of database of database.
Optionally, the storage information, further includes: for storing the partition information of the data to be retrieved and for looking into
Look for the index information of the data to be retrieved.
Optionally, the retrieval request also includes: the processing sentence handled the data retrieved, the processing language
Sentence includes: for the data retrieved to be carried out with the statistics sentence of statistical disposition, is filtered processing to the data retrieved
Filtering sentence and the custom variable that the data retrieved are carried out with customized processing；
The acquisition module, for the primary sentence to be sent to the database, from the database lookup and institute
The corresponding data of metadata title are stated, the data found handle and by treated according to the processing sentence
Data are as the data to be retrieved.
Optionally, the system also includes:
Parsing module, for the data to be retrieved to be resolved to scheduled format.
Data retrieval method provided in an embodiment of the present invention and system, since the corresponding first number of each data has been stored in advance
According to the type of title and the database to match with metadata title, therefore, when receiving the corresponding metadata of data to be retrieved
When title, information according to the pre-stored data can be stored to determine the type for the database for storing data to be retrieved, then will be examined
Rope request is converted into the primary sentence that the database of the type is able to carry out, and then obtains from the database of the type to be retrieved
Data.Namely user is when needing to carry out data retrieval, it is only necessary to inputting metadata title can be completed retrieval, without with
Query grammar, database table structure and field type used in database etc. is grasped at family, to reduce the difficulty of data retrieval.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is a kind of data retrieval schematic diagram of a scenario provided in an embodiment of the present invention；
Fig. 2 is a kind of flow diagram of data retrieval method provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of data retrieval system provided in an embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
The embodiment of the invention provides a kind of data retrieval method, this method can be applied to system framework shown in FIG. 1
In.The system framework includes: UI (User Interface, user interface), grammer converter, meta data manager and data
Source manager.
In an implementation, business personnel inputs retrieval request by UI；First number that grammer converter will include in retrieval request
It is sent to meta data manager according to title, meta data manager is believed according to the metadata title received in pre-stored storage
The storage information of the metadata title comprising receiving is searched in breath, and storage information is sent to grammer converter；Grammer turns
Change device and determines the data for storing data to be retrieved according to the metadata title for including in the storage information and retrieval request received
The type in library, by retrieval request be converted into the primary sentence that is able to carry out of certain type of database and primary sentence is sent
To data source manager；Data source manager obtains number to be retrieved from the certain type of database of institute after receiving primary sentence
According to and return to UI and carry out display search result.
Below in conjunction with specific embodiment, process flow shown in Fig. 2 is described in detail, content can be as
Under:
Step 200, retrieval request is received.
Wherein, retrieval request includes the corresponding metadata title of data to be retrieved.
The corresponding metadata title of above-mentioned data to be retrieved is namely used to describe the data of data to be retrieved.For example, to
Retrieval data are a student information, and the field in information includes: name (name), age (age), gender (male), class
(class) etc., then name, age, male, class are exactly metadata title, the corresponding specifying information of metadata title is that is, first
Data also just constitute student information.For example, obtained student information are as follows: small red, 13, female, one class.
Step 210, storage information and metadata title according to the pre-stored data determine the database for storing data to be retrieved
Type.
Wherein, storage information includes: the type of metadata title and the database to match with metadata title.
The type of the above-mentioned database to match with metadata title namely is used to store the class of the database of metadata
Type.
Since metadata title is the data for describing data to be retrieved, each metadata just constitutes number to be retrieved
According to, thus, in the type for searching the database to match with metadata title in storage information using metadata title, looked into
Find database type namely store data to be retrieved database type.
In a kind of implementation, the metadata title for including in retrieval request and the member for including in storage information can use
Data name is referred to as intersection, when the metadata title for including in storage information includes the whole metadata titles for including in retrieval request
When, then it can determine that the type of the database to match in storage information with metadata title is the number for storing data to be retrieved
According to the type in library.
In an implementation, in order to accelerating the subsequent efficiency for obtaining information to be retrieved in the database, above-mentioned storage information
In can also include: the partition information for storing data to be retrieved and the index information for searching data to be retrieved.
Partition information i.e. data to be retrieved in the database where subregion information, it is subsequent in this way from database
When middle lookup information to be retrieved, it can be searched in the direct subregion.
For index information namely for the sequencing information of the value of one or more columns per page in the table of descriptive data base library, function is similar
In the catalogue of book, the data in the table of data Kuku can be quickly accessed using index information.
In the present embodiment, due to storage information in further comprise partition information and index information, can be improved it is subsequent from
Efficiency when information to be retrieved is searched in database, compared to the prior art in need business personnel to have to be understood that data to be retrieved
Partitioning scenario and index situation just can have higher recall precision for, greatly reduce retrieval difficulty.
Step 220, the primary language that the type database is able to carry out is converted for retrieval request according to the type of database
Sentence.
In an implementation, grammer used in different types of database is different, then can be with after type has been determined
Using grammer used in the type database, the sentence that the type database is able to carry out is converted by retrieval request, also
It is primary sentence.
Step 230, data to be retrieved are obtained from database using primary sentence.
In an implementation, primary sentence can be sent to database, database is in the data that itself is stored according to primary
Sentence searches data to be retrieved, and then obtains data to be retrieved.
In a kind of implementation, using primary sentence from the mistakes of data to be retrieved is obtained in certain type of database
Cheng Zhong, can use the type of database, address, port search whether client-cache there are the database instance, if
In the presence of then directly data to be retrieved are obtained using client-cache, the data otherwise can be created according to the information of database
The client-cache of library example, from being obtained in database after data to be retrieved and by the client of data buffer storage to be retrieved to creation
In the caching of end, facilitate later retrieval.
In an implementation, a data are potentially stored in different types of database, it is also possible to are stored in same type of
In disparate databases, thus, when data to be retrieved store in multiple databases, then need to select one of database
To carry out data retrieval.
In such cases, for each database, storing information can also include: the title of database, index information pair
The indexing parameter answered, the storage parameter for characterization database amount of storage and the ginseng of the performance for characterization database storage performance
Number；
Specifically, indexing parameter may include: index type and index radix；
Storing parameter may include: library table size, library table row number, library table columns and time granularity；
Performance parameter may include: the average IO (Input/Output, input/output) of database and putting down for database
Load.
Each above-mentioned parameter will affect the recall precision of data, for example, used retrieval mode is if appropriate for this
The retrieval of categorical data；It is lower to index the corresponding more recall precisions of value of the bigger expression data of radix, for example, gender only includes male
Female, thus gender index radix corresponding compared to name is small, the other efficiency of accessibility is then higher than the efficiency of retrieval name.
Library table size, library table row number, library table columns and the smaller data volume for showing storage of time granularity are smaller, accordingly
Recall precision is higher.
The average IO (Input/Output, input/output) of database and the average load of database are smaller, accordingly
Recall precision is higher.
Based on this, in a kind of implementation, a weight, the weight table of each parameter can be distributed for parameters in advance
Show significance level of the parameter in parameters, the weight of each parameter can be the same or different；Then further according to each
The value of a parameter determines the contribution degrees of parameters, and the contribution degree of each parameter then indicates the parameter when assessing database
Significance level, for example, when library table row number is significance level highest of a period of time library table row number when assessing database, specifically, library
Table row number is that for the moment, the contribution degree of the parameter is 100；When library table row number is two, the contribution degree of the parameter is 95.It finally will be each
The weight of parameter is multiplied with contribution degree, then each product addition is obtained the comprehensive score of database.
Specifically, weight and the tribute of the corresponding each indexing parameter of each database can be obtained when selecting database
The weight and contribution degree of degree of offering, the weight of each storage parameter and contribution degree and each performance parameter；
For each database, weight and contribution degree are weighted to obtain the comprehensive score of the database；
The primary sentence that the highest database of comprehensive score is able to carry out is converted by retrieval request；
Data to be retrieved are obtained from the highest database of comprehensive score using primary sentence.
Comprehensively consider the parameter of each database to select the highest database of comprehensive performance as searched targets, so as to
Enough improve the efficiency of data retrieval.
In an implementation, business personnel may need to carry out at analysis the data retrieved while carrying out data retrieval
Reason, at this point, business personnel then can input retrieve information when, while input metadata title and to the data retrieved into
The processing sentence of row processing, such system, can be according to processing sentences to inspection after retrieving data by metadata title
Rope to data carry out processing to obtaining data to be retrieved needed for business personnel.
Above-mentioned processing sentence may include: for the data retrieved to be carried out with the statistics sentence of statistical disposition, to retrieval
To data be filtered the filtering sentence of processing and the data retrieved carried out with the custom variable of customized processing.
Statistics sentence namely carries out the information of statistical disposition to the data retrieved, for example, metadata title are as follows: two classes
Student performance；Counting sentence can be with are as follows: the average value of boy student's achievement in two classes of students, at this point, then can according to two classes of students at
Achievement finds the data of two classes of students in the database, then counts the data of each boy student and calculates the average value of boy student's achievement
As information to be retrieved.In an implementation, subsequent to convert primary sentence for retrieval request when in retrieval request comprising statistics sentence
When, it according to statistics sentence generative grammar tree and can be traversed, go out logic symbol according to the type statistics of leaf node, compare
Four kinds of symbol, numerical value, field statistical calculation types transport the statistics counted further according to the grammer that determined types of database uses
It calculates type to be translated, generates the primary sentence that can directly execute.
Filtering sentence is namely filtered the information of processing to the data retrieved, for example, metadata title are as follows: two classes
Student performance；Filtering sentence can be with are as follows: boy student's achievement in two classes of students, at this point, then can be according to two classes of student performances in data
The data of two classes of students are found in library, then filter out the data of each schoolgirl, and are obtained in the data of each boy student each
The achievement of boy student.It is in an implementation, subsequent when converting primary sentence for retrieval request when in retrieval request comprising filtering sentence,
It according to filtering sentence generative grammar tree and can be traversed, so that sentence is divided into dimension field, static fields, statistics side
Method, four seed type of sequencing information, the grammer used further according to determined types of database respectively to dimension field, static fields,
Statistical method, sequencing information are translated, and the primary sentence that can directly execute is generated.
In an implementation, business personnel would generally according to their needs be handled the data retrieved, at this point, then may be used
It defines how to handle the data retrieved in the form of custom variable, for example, a variable characterizes a kind of data
Processing mode.
In a kind of implementation, custom lists can be pre-established, each variable and variable are stored in custom lists
Corresponding variate-value, in this way when business personnel is after input variable, system then can search variable pair according to custom lists
The variate-value answered, and then determine how and the data retrieved are handled.
In another implementation, it can also be defined by way of custom variable and make the search result of other data
For this detection processing sentence, for example, metadata title are as follows: two classes of student performances；Custom variable are as follows: be higher than one class of student
Then achievement average value retrieves two classes at this point, then can first retrieve one class of student information and calculate one class of student performance average value
Student information, finally statistics is achieved the result higher than the achievement of each student of one class of student performance average value.
It defines how to handle the data retrieved by way of custom variable, business personnel can pass through
It is changing custom variable to influence retrieval analysis as a result, be greatly improved the convenience of business personnel's retrieval analysis data,
And it when only some change in retrieval request, does not need to rewrite entire retrieval request again and only need to configure customized change
Amount.
In an implementation, search result is checked in order to facilitate business personnel, it can be after obtaining data to be retrieved, it will be to be checked
Rope data resolve to scheduled format.For example, can use the form that data to be retrieved are resolved to list by data parser, from
And data to be retrieved can be shown in the form of a list, facilitate business personnel to check.
Data retrieval method provided in an embodiment of the present invention and system, since the corresponding first number of each data has been stored in advance
According to the type of title and the database to match with metadata title, therefore, when receiving the corresponding metadata of data to be retrieved
When title, information according to the pre-stored data can be stored to determine the type for the database for storing data to be retrieved, then will be examined
Rope request is converted into the primary sentence that is able to carry out of the certain type of database of institute, so from obtain in certain type of database
Obtain data to be retrieved.Namely user is when needing to carry out data retrieval, it is only necessary to and inputting metadata title can be completed retrieval,
Query grammar, database table structure and field type used in database etc. is grasped without user, to reduce data retrieval
Difficulty.Also, store information in include partition information and index information when, compared to the prior art in need business people
For member have to be understood that the partitioning scenario of data to be retrieved and index situation just there can be higher recall precision, greatly reduce
Retrieve difficulty.In addition, business personnel can also in retrieval request input processing sentence so that business personnel can pass through
It is changing processing sentence to influence retrieval analysis as a result, be greatly improved the convenience of business personnel's retrieval analysis data, and
And when only some change in retrieval request, do not need to rewrite entire retrieval request again and only need to configure to handle to expect i.e.
It can.
Based on the same technical idea, the embodiment of the invention also provides a kind of data retrieval systems, as shown in figure 3, institute
The system of stating includes:
Receiving module 300, for receiving retrieval request, wherein the retrieval request includes the corresponding member of data to be retrieved
Data name；
Memory module 310, be used for storage information according to the pre-stored data and the metadata title, determine storage described in
Retrieve the type of the database of data；
Conversion module 320, for converting the type database for the retrieval request according to the type of the database
The primary sentence being able to carry out；
Module 330 is obtained, for obtaining the data to be retrieved from the database using the primary sentence.
Optionally, the conversion module 320 is also used to obtain the corresponding each indexing parameter of each database, every
The weight and contribution degree of one storage parameter and each performance parameter；
For each database, it is weighted to obtain the comprehensive of the database to the weight and contribution degree
Point；
The primary sentence that the highest database of the comprehensive score is able to carry out is converted by the retrieval request.
Optionally, the acquisition module 330 is also used to using the primary sentence from the highest database of comprehensive score
Obtain the data to be retrieved.
Optionally, the indexing parameter includes: index type and index radix；
The storage parameter includes: library table size, library table row number, library table columns and time granularity；
The performance parameter includes: average IO and the average load of database of database.
Optionally, the storage information, further includes: for storing the partition information of the data to be retrieved and for looking into
Look for the index information of the data to be retrieved.
Optionally, the retrieval request also includes: the processing sentence handled the data retrieved, the processing language
Sentence includes: for the data retrieved to be carried out with the statistics sentence of statistical disposition, is filtered processing to the data retrieved
Filtering sentence and the custom variable that the data retrieved are carried out with customized processing；
The acquisition module 330, for the primary sentence to be sent to the database, from the database lookup with
The data found are carried out processing according to the processing sentence and will be after processing by the corresponding data of the metadata title
Data as the data to be retrieved.
Optionally, the system also includes:
Parsing module, for the data to be retrieved to be resolved to scheduled format.
Data retrieval method provided in an embodiment of the present invention and system, since the corresponding first number of each data has been stored in advance
According to the type of title and the database to match with metadata title, therefore, when receiving the corresponding metadata of data to be retrieved
When title, information according to the pre-stored data can be stored to determine the type for the database for storing data to be retrieved, then will be examined
Rope request is converted into the primary sentence that is able to carry out of the certain type of database of institute, so from obtain in certain type of database
Obtain data to be retrieved.Namely user is when needing to carry out data retrieval, it is only necessary to and inputting metadata title can be completed retrieval,
Query grammar, database table structure and field type used in database etc. is grasped without user, to reduce data retrieval
Difficulty.Also, store information in include partition information and index information when, compared to the prior art in need business people
For member have to be understood that the partitioning scenario of data to be retrieved and index situation just there can be higher retrieval performance, greatly reduce
Retrieve difficulty.In addition, business personnel can also in retrieval request input processing sentence so that business personnel can pass through
It is changing processing sentence to influence retrieval analysis as a result, be greatly improved the convenience of business personnel's retrieval analysis data, and
And when only some change in retrieval request, do not need to rewrite entire retrieval request again and only need to configure to handle to expect i.e.
It can.
It should be understood that data retrieval system provided by the above embodiment is when retrieving data, only with above-mentioned each function
The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds
Block is completed, i.e., the internal structure of system is divided into different functional modules, to complete all or part of function described above
Energy.In addition, the embodiment of data retrieval system provided by the above embodiment and data retrieval method belongs to same design, it is specific
Realization process is detailed in embodiment of the method, and which is not described herein again.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (14)
1. a kind of data retrieval method, which is characterized in that the described method includes:
Receive retrieval request, wherein the retrieval request includes the corresponding metadata title of data to be retrieved；
Storage information according to the pre-stored data and the metadata title determine the class for storing the database of the data to be retrieved
Type；
The primary sentence that the type database is able to carry out is converted by the retrieval request according to the type of the database；
The data to be retrieved are obtained from the database using the primary sentence.
2. the method as described in claim 1, which is characterized in that the type according to the database is by the retrieval request
The step of being converted into the primary sentence that the type database is able to carry out, comprising:
Obtain the corresponding each indexing parameter of each database, it is each storage parameter and each performance parameter weight and
Contribution degree；
For each database, the weight and contribution degree are weighted to obtain the comprehensive score of the database；
The primary sentence that the highest database of the comprehensive score is able to carry out is converted by the retrieval request.
3. method according to claim 2, which is characterized in that described to be obtained from the database using the primary sentence
The step of data to be retrieved, comprising:
The data to be retrieved are obtained from the highest database of comprehensive score using the primary sentence.
4. method according to claim 2, which is characterized in that the indexing parameter includes: index type and index radix；
The storage parameter includes: library table size, library table row number, library table columns and time granularity；
The performance parameter includes: average IO and the average load of database of database.
5. method according to any of claims 1-4, which is characterized in that the storage information, further includes: for storing
State the partition information of data to be retrieved and the index information for searching the data to be retrieved.
6. the method as described in claim 1, which is characterized in that the retrieval request also includes: being carried out to the data retrieved
The processing sentence of processing, the processing sentence include: for the data retrieved to be carried out with the statistics sentence of statistical disposition, to inspection
Rope to data be filtered the filtering sentence of processing and the data retrieved carried out with the custom variable of customized processing；
Described the step of obtaining the data to be retrieved from the database using the primary sentence, comprising:
The primary sentence is sent to the database, from database lookup number corresponding with the metadata title
According to, the data found handle according to the processing sentence and will treated data as the number to be retrieved
According to.
7. the method as described in claim 1, which is characterized in that described to be obtained from the database using the primary sentence
After the step of data to be retrieved, further includes:
The data to be retrieved are resolved into scheduled format.
8. a kind of data retrieval system, which is characterized in that the system comprises:
Receiving module, for receiving retrieval request, wherein the retrieval request includes the corresponding metadata name of data to be retrieved
Claim；
Memory module is used for storage information according to the pre-stored data and the metadata title, determines and stores the number to be retrieved
According to database type；
Conversion module converts the type database for the retrieval request for the type according to the database and is able to carry out
Primary sentence；
Module is obtained, for obtaining the data to be retrieved from the database using the primary sentence.
9. system as claimed in claim 8, which is characterized in that
The conversion module, be also used to obtain the corresponding each indexing parameter of each database, each storage parameter and
The weight and contribution degree of each performance parameter；
For each database, the weight and contribution degree are weighted to obtain the comprehensive score of the database；
The primary sentence that the highest database of the comprehensive score is able to carry out is converted by the retrieval request.
10. device as claimed in claim 9, which is characterized in that
The acquisition module is also used to obtain from the highest database of comprehensive score using the primary sentence described to be retrieved
Data.
11. system as claimed in claim 9, which is characterized in that the indexing parameter includes: index type and index base
Number；
The storage parameter includes: library table size, library table row number, library table columns and time granularity；
The performance parameter includes: average IO and the average load of database of database.
12. such as the described in any item systems of claim 8-11, which is characterized in that the storage information, further includes: for storing
The partition information of the data to be retrieved and index information for searching the data to be retrieved.
13. system as claimed in claim 8, which is characterized in that the retrieval request also includes: being carried out to the data retrieved
The processing sentence of processing, the processing sentence include: for the data retrieved to be carried out with the statistics sentence of statistical disposition, to inspection
Rope to data be filtered the filtering sentence of processing and the data retrieved carried out with the custom variable of customized processing；
The acquisition module, for the primary sentence to be sent to the database, from the database lookup and the member
The data found handle and will treated data by the corresponding data of data name according to the processing sentence
As the data to be retrieved.
14. system as claimed in claim 8, which is characterized in that the system also includes:
Parsing module, for the data to be retrieved to be resolved to scheduled format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294057.XA CN110046163A (en) | 2019-04-12 | 2019-04-12 | A kind of data retrieval method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294057.XA CN110046163A (en) | 2019-04-12 | 2019-04-12 | A kind of data retrieval method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110046163A true CN110046163A (en) | 2019-07-23 |
Family
ID=67276967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910294057.XA Pending CN110046163A (en) | 2019-04-12 | 2019-04-12 | A kind of data retrieval method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110046163A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656434A (en) * | 2021-08-17 | 2021-11-16 | 广州市规划和自然资源自动化中心(广州市基础地理信息中心) | Data query method and device, computer equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645074A (en) * | 2009-09-07 | 2010-02-10 | 浪潮集团山东通用软件有限公司 | Method for accessing relational databases of different types |
| CN103425683A (en) * | 2012-05-18 | 2013-12-04 | 上海宝信软件股份有限公司 | Database performance test system |
| CN103914572A (en) * | 2014-04-29 | 2014-07-09 | 福建星网视易信息系统有限公司 | Database construction system, device and method |
| CN104361099A (en) * | 2014-11-21 | 2015-02-18 | 北京邮电大学 | Adaptive device facing heterogeneous storage |
| CN105260403A (en) * | 2015-09-22 | 2016-01-20 | 广东同望科技股份有限公司 | Universal cross-database access method |
| CN108710652A (en) * | 2018-05-09 | 2018-10-26 | 长城计算机软件与系统有限公司 | A kind of data analysing method and system, storage medium based on statistics |
| CN109241096A (en) * | 2018-08-01 | 2019-01-18 | 北京京东金融科技控股有限公司 | Data processing method, device and system |
-
2019
- 2019-04-12 CN CN201910294057.XA patent/CN110046163A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645074A (en) * | 2009-09-07 | 2010-02-10 | 浪潮集团山东通用软件有限公司 | Method for accessing relational databases of different types |
| CN103425683A (en) * | 2012-05-18 | 2013-12-04 | 上海宝信软件股份有限公司 | Database performance test system |
| CN103914572A (en) * | 2014-04-29 | 2014-07-09 | 福建星网视易信息系统有限公司 | Database construction system, device and method |
| CN104361099A (en) * | 2014-11-21 | 2015-02-18 | 北京邮电大学 | Adaptive device facing heterogeneous storage |
| CN105260403A (en) * | 2015-09-22 | 2016-01-20 | 广东同望科技股份有限公司 | Universal cross-database access method |
| CN108710652A (en) * | 2018-05-09 | 2018-10-26 | 长城计算机软件与系统有限公司 | A kind of data analysing method and system, storage medium based on statistics |
| CN109241096A (en) * | 2018-08-01 | 2019-01-18 | 北京京东金融科技控股有限公司 | Data processing method, device and system |
Non-Patent Citations (1)
| Title |
|---|
| 紫月风清: "数据研究之综合评分-权重评分指标", 《CSDN》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656434A (en) * | 2021-08-17 | 2021-11-16 | 广州市规划和自然资源自动化中心(广州市基础地理信息中心) | Data query method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang et al. | Q2semantic: A lightweight keyword interface to semantic search | |
| US8862458B2 (en) | Natural language interface | |
| US11120059B2 (en) | Conversational query answering system | |
| US11941034B2 (en) | Conversational database analysis | |
| JP6014725B2 (en) | Retrieval and information providing method and system for single / multi-sentence natural language queries | |
| CN107038207A (en) | A kind of data query method, data processing method and device | |
| CN109947952B (en) | Retrieval method, device, equipment and storage medium based on English knowledge graph | |
| CN108304444A (en) | Information query method and device | |
| US20110191335A1 (en) | Method and system for conducting legal research using clustering analytics | |
| CN111061828B (en) | Digital library knowledge retrieval method and device | |
| CN109033314A (en) | The Query method in real time and system of extensive knowledge mapping in the case of memory-limited | |
| US11507555B2 (en) | Multi-layered key-value storage | |
| Nikhil et al. | A survey on text mining and sentiment analysis for unstructured web data | |
| CN115757689A (en) | Information query system, method and equipment | |
| Noubours et al. | NLP as an essential ingredient of effective OSINT frameworks | |
| CN110046163A (en) | A kind of data retrieval method and system | |
| CN116226494A (en) | Crawler system and method for information search | |
| Abramowicz et al. | Supporting topic map creation using data mining techniques | |
| Martínez-Castaño et al. | Polypus: a big data self-deployable architecture for microblogging text extraction and real-time sentiment analysis | |
| CN107766545A (en) | Scientific and technological data management method and device | |
| EP3771990A1 (en) | Object indexing | |
| CN114064606A (en) | Database migration method, device, equipment, storage medium and system | |
| Li et al. | Design of a Global Retrieval System for Characteristic Data Based on SOLR | |
| Wen et al. | Clustering web search results using semantic information | |
| Yang et al. | A matching model of mathematical expressions with FDS based index |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190723 |
|
| RJ01 | Rejection of invention patent application after publication |