CN104462461B - The method and device of investigation processing empty value is carried out to list - Google Patents
The method and device of investigation processing empty value is carried out to list Download PDFInfo
- Publication number
- CN104462461B CN104462461B CN201410784527.8A CN201410784527A CN104462461B CN 104462461 B CN104462461 B CN 104462461B CN 201410784527 A CN201410784527 A CN 201410784527A CN 104462461 B CN104462461 B CN 104462461B
- Authority
- CN
- China
- Prior art keywords
- list
- index data
- data
- value
- lists
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24535—Query rewriting; Transformation of sub-queries or views
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a kind of method and device for list investigate processing empty value, methods described includes：All lists in database, and the index data corresponding with each list are obtained, and obtains the retrieval information of user configuring；Judge whether the data volume of the index data corresponding with each list is more than minimum data amount；When the data volume of the single-phase corresponding index data of judgement and either table is more than minimum data amount, calculate and the ratio shared by the null value in the single-phase corresponding index data of either table；Ratio and maximum null value ratio according to shared by with the null value in the single-phase corresponding index data of either table, judge whether that needs pair carry out investigation processing empty value with the single-phase corresponding index data of either table；The list for needing to carry out investigation processing empty value in all lists is recorded, investigation processing empty value is carried out with the list that automatic phasing is answered.Technical scheme can be realized automatically and accurately carries out investigation processing empty value to corresponding list, is effectively improved search efficiency.
Description
Technical field
The present invention relates to computer information technology field, investigation processing empty value is carried out to list in particular to a kind of
Method and it is a kind of to list carry out investigate processing empty value device.
Background technology
ERP (Enterprise Resource Planning, Enterprise Resources Plan) system is normally based on certain scene
Used, such as process of factory production has only used manufacturing module, therefore factory can make substantial amounts of production order by oneself
Carry out Instructing manufacture, but with the increase of business, the later stage may enable production schedule module, by planning come Instructing manufacture, this
When will be converted into by plan production order come Instructing manufacture；It is exactly the source for needing to produce order record oneself in the process
It is which document planned is converted, to facilitate the inquiry of user, i.e., so-called document reviews source relation in ERP products
Figure.But user can have been found that to increase index in source record in use, it is very big to may result in efficiency, if
Plus index, this scene as more than, because the null value of production order source record field is more, it is impossible to hit index, is led
Cause index failure；
In the utilization of practice, if in order to improve the execution efficiency of product in certain company ERP products, common practice is
Emptying process is carried out, that is, investigates the more item of null value, condition is emptied in inquiry, but be due to the usage scenario of user
It is especially many, if the increase emptying of blindness, can increase the burden of inquiry system, so as to cause that due work can not be played on the contrary
With, and the scheme of prior art is the problem of accurately can not handle similar.
Therefore, how automatically and accurately to realize the investigation processing empty value to list, so improve search efficiency into
For technical problem urgently to be resolved hurrily.
The content of the invention
The present invention is based at least one above-mentioned technical problem, it is proposed that a kind of new is carried out to list at investigation null value
Reason scheme, can automatically and accurately realize and carry out investigation processing empty value to corresponding list, be effectively improved search efficiency.
Meanwhile, neatly retrieval information can also be configured according to the demand of user, meet the demand of different user.
In view of this, the present invention proposes a kind of method for carrying out investigating processing empty value to list, including：Obtain database
In all lists, and the index data corresponding with each list in all lists, and obtain user configuring
Information is retrieved, the retrieval packet is containing the corresponding minimum data amount of the index data and the maximum null value ratio allowed；For
Each list in all lists, judges whether the data volume of the index data corresponding with each list is more than institute
State minimum data amount；When the data volume of the single-phase corresponding index data of judgement and either table is more than the minimum data amount, meter
Calculate and the ratio shared by the null value in the single-phase corresponding index data of the either table；According to single-phase corresponding with the either table
Ratio shared by null value and the maximum null value ratio in index data, judge whether to need pair single-phase corresponding with the either table
Index data carry out investigation processing empty value；Record needed in all lists carry out investigation processing empty value list, with
When user is indexed inquiry to the list in the database, the list that automatic phasing is answered carries out investigation processing empty value.
In the technical scheme, carried out by pair data volume of the index data corresponding with each list and null value ratio
Analysis, can accurately determine the list for needing to carry out investigation processing empty value, and then cause in user to the list in database
When being indexed inquiry, it can automatically realize and be emptied to corresponding list and (investigate null value) processing, be effectively improved
Search efficiency.Simultaneously as be according to the retrieval information of user configuring carry out analyzing and processing, therefore also allow for according to
The demand at family is neatly configured to retrieval information, to meet the demand of different user.
In the above-mentioned technical solutions, it is preferable that also include：According to the information of all lists and with each list
The relation of corresponding index data, the title of establishment each list and the index data corresponding with each list
Table, to be analyzed by a pair index data corresponding with each list in the relation table, it is determined that with each table
Whether single-phase corresponding index data needs to carry out investigation processing empty value.
In the technical scheme, by creating the title of each list and the pass of the index data corresponding with each list
It is table, enabling the relation between the title and corresponding index data of list is clearly shown, while can also be easy to
The index data of list is analyzed one by one according to relation table.
In the above-mentioned technical solutions, it is preferable that before the step of all lists in obtaining the database, also wrap
Include：Set up the connection with the database；It is determined that during with the database successful connection, performing and obtaining in the database
All lists, and the step of corresponding with each list index data.
In the above-mentioned technical solutions, it is preferable that judging the data volume of the index data corresponding with each list
Before the step of whether being more than the minimum data amount, in addition to：Judging the index data corresponding with each list is
It is no to exist；In the presence of the index data corresponding with each list is judged, perform and judge relative with each list
The step of whether data volume for the index data answered is more than the minimum data amount.
In the above-mentioned technical solutions, it is preferable that calculate and the null value institute in the single-phase corresponding index data of the either table
The step of ratio accounted for, specifically includes：Statistics and the data shared by the null value in the single-phase corresponding index data of the either table
Amount；Calculate and the data volume shared by the null value in the single-phase corresponding index data of the either table and single-phase right with the either table
Ratio between the data volume for the index data answered, to obtain and the null value institute in the single-phase corresponding index data of the either table
The ratio accounted for.
According to another aspect of the present invention, it is also proposed that it is a kind of to list carry out investigate processing empty value device, including：Obtain
Unit is taken, for obtaining all lists in database, and the index corresponding with each list in all lists
Data, and for obtaining the retrieval information of user configuring, the retrieval packet corresponding minimum data containing the index data
Amount and the maximum null value ratio allowed；First judging unit, it is corresponding with each list in all lists for judging
Whether the data volume of index data is more than the minimum data amount；Computing unit, for first judging unit judge with
When the data volume of the single-phase corresponding index data of either table is more than the minimum data amount, calculate single-phase corresponding with the either table
Index data in null value shared by ratio；Second judging unit, for the single-phase corresponding index of basis and the either table
Ratio shared by null value and the maximum null value ratio in data, judge whether to need pair and the single-phase corresponding rope of the either table
Argument is according to progress investigation processing empty value；Recording unit, for the judged result according to second judging unit, records the institute
There is the list for needing to carry out investigation processing empty value in list, to be indexed inquiry to the list in the database in user
When, the list that automatic phasing is answered carries out investigation processing empty value.
In the technical scheme, carried out by pair data volume of the index data corresponding with each list and null value ratio
Analysis, can accurately determine the list for needing to carry out investigation processing empty value, and then cause in user to the list in database
When being indexed inquiry, it can automatically realize and be emptied to corresponding list and (investigate null value) processing, be effectively improved
Search efficiency.Simultaneously as be according to the retrieval information of user configuring carry out analyzing and processing, therefore also allow for according to
The demand at family is neatly configured to retrieval information, to meet the demand of different user.
In the above-mentioned technical solutions, it is preferable that also include：Creating unit, for the information according to all lists and
The index data corresponding with each list, creates the title of each list and corresponding with each list
The relation table of index data, to be analyzed by a pair index data corresponding with each list in the relation table, really
Whether the fixed index data corresponding with each list needs to carry out investigation processing empty value.
In the technical scheme, by creating the title of each list and the pass of the index data corresponding with each list
It is table, enabling the relation between the title and corresponding index data of list is clearly shown, while can also be easy to
The index data of list is analyzed one by one according to relation table.
In the above-mentioned technical solutions, it is preferable that also include：Connection establishment unit, for setting up the company with the database
Connect；The acquiring unit is specifically for when the connection establishment unit is determined with the database successful connection, performing acquisition
All lists in the database, and the index data corresponding with each list operation.
In the above-mentioned technical solutions, it is preferable that also include：3rd judging unit, for judging and each list phase
Corresponding index data whether there is；First judging unit specifically for, the 3rd judging unit judge with it is described
In the presence of the corresponding index data of each list, the data volume for judging the index data corresponding with each list is performed
Whether the operation of the minimum data amount is more than.
In the above-mentioned technical solutions, it is preferable that the computing unit includes：Statistic unit, for count with it is described any
The data volume shared by null value in the corresponding index data of list；Execution unit, it is single-phase right with the either table for calculating
Data volume shared by null value in the index data answered and between the data volume of the single-phase corresponding index data of the either table
Ratio, to obtain and the ratio shared by the null value in the single-phase corresponding index data of the either table.
By above technical scheme, it can automatically and accurately realize and investigation processing empty value is carried out to corresponding list, have
Improve search efficiency to effect.Meanwhile, neatly retrieval information can also be configured according to the demand of user, met not
With the demand of user.
Brief description of the drawings
Fig. 1 shows the exemplary flow for the method for list investigate processing empty value according to an embodiment of the invention
Figure；
Fig. 2 shows the schematic block diagram for the device for list investigate processing empty value according to an embodiment of the invention；
Fig. 3 shows the interface signal for checking large database concept index hit analysis tool according to an embodiment of the invention
Figure；
Fig. 4 shows showing for the method that index hit is analyzed in detection large database concept according to an embodiment of the invention
Meaning flow chart；
Fig. 5 shows the schematic block of the device of index hit analysis in detection large database concept according to an embodiment of the invention
Figure；
Fig. 6, which is shown in detection large database concept according to another embodiment of the invention, indexes the method that hit is analyzed
Schematic flow diagram；
Fig. 7 shows SQL statement schematic diagram when performing inquiry operation according to an embodiment of the invention.
Embodiment
It is below in conjunction with the accompanying drawings and specific real in order to be more clearly understood that the above objects, features and advantages of the present invention
Mode is applied the present invention is further described in detail.It should be noted that in the case where not conflicting, the implementation of the application
Feature in example and embodiment can be mutually combined.
Many details are elaborated in the following description to facilitate a thorough understanding of the present invention, still, the present invention may be used also
Implemented with being different from other modes described here using other, therefore, protection scope of the present invention is not by described below
Specific embodiment limitation.
Fig. 1 shows the exemplary flow for the method for list investigate processing empty value according to an embodiment of the invention
Figure.
As shown in figure 1, the method for investigating processing empty value is carried out to list according to an embodiment of the invention, including：Step
102, all lists in database, and the index data corresponding with each list in all lists are obtained, and
The retrieval information of user configuring is obtained, the retrieval packet is containing the corresponding minimum data amount of the index data and allows most
Big null value ratio；Step 104, for each list in all lists, the index corresponding with each list is judged
Whether the data volume of data is more than the minimum data amount；Step 106, in the single-phase corresponding index data of judgement and either table
When data volume is more than the minimum data amount, calculate and the ratio shared by the null value in the single-phase corresponding index data of the either table
Example；Step 108, the ratio and the maximum null value according to shared by with the null value in the single-phase corresponding index data of the either table
Than judging whether that needs pair carry out investigation processing empty value with the single-phase corresponding index data of the either table；Step 110, record
The list for carrying out investigating processing empty value is needed in all lists, to be indexed in user to the list in the database
During inquiry, the list that automatic phasing is answered carries out investigation processing empty value.
In the technical scheme, carried out by pair data volume of the index data corresponding with each list and null value ratio
Analysis, can accurately determine the list for needing to carry out investigation processing empty value, and then cause in user to the list in database
When being indexed inquiry, it can automatically realize and be emptied to corresponding list and (investigate null value) processing, be effectively improved
Search efficiency.Simultaneously as be according to the retrieval information of user configuring carry out analyzing and processing, therefore also allow for according to
The demand at family is neatly configured to retrieval information, to meet the demand of different user.
In the above-mentioned technical solutions, it is preferable that also include：According to the information of all lists and with each list
The relation of corresponding index data, the title of establishment each list and the index data corresponding with each list
Table, to be analyzed by a pair index data corresponding with each list in the relation table, it is determined that with each table
Whether single-phase corresponding index data needs to carry out investigation processing empty value.
In the technical scheme, by creating the title of each list and the pass of the index data corresponding with each list
It is table, enabling the relation between the title and corresponding index data of list is clearly shown, while can also be easy to
The index data of list is analyzed one by one according to relation table.
In the above-mentioned technical solutions, it is preferable that before the step of all lists in obtaining the database, also wrap
Include：Set up the connection with the database；It is determined that during with the database successful connection, performing and obtaining in the database
All lists, and the step of corresponding with each list index data.
In the above-mentioned technical solutions, it is preferable that judging the data volume of the index data corresponding with each list
Before the step of whether being more than the minimum data amount, in addition to：Judging the index data corresponding with each list is
It is no to exist；In the presence of the index data corresponding with each list is judged, perform and judge relative with each list
The step of whether data volume for the index data answered is more than the minimum data amount.
In the above-mentioned technical solutions, it is preferable that calculate and the null value institute in the single-phase corresponding index data of the either table
The step of ratio accounted for, specifically includes：Statistics and the data shared by the null value in the single-phase corresponding index data of the either table
Amount；Calculate and the data volume shared by the null value in the single-phase corresponding index data of the either table and single-phase right with the either table
Ratio between the data volume for the index data answered, to obtain and the null value institute in the single-phase corresponding index data of the either table
The ratio accounted for.
Fig. 2 shows the schematic block diagram for the device for list investigate processing empty value according to an embodiment of the invention.
As shown in Fig. 2 to list investigate the device 200 of processing empty value according to an embodiment of the invention, including：Obtain
Unit 202 is taken, for obtaining all lists in database, and the rope corresponding with each list in all lists
Argument evidence, and for obtaining the retrieval information of user configuring, the retrieval packet corresponding minimum number containing the index data
According to amount and the maximum null value ratio allowed；First judging unit 204 is relative with each list in all lists for judging
Whether the data volume for the index data answered is more than the minimum data amount；Computing unit 206, in first judging unit
204 when judging to be more than the minimum data amount with the data volume of the single-phase corresponding index data of either table, calculating with it is described any
The ratio shared by null value in the corresponding index data of list；Second judging unit 208, for basis and any list
Ratio shared by null value and the maximum null value ratio in corresponding index data, judge whether to need pair and the either table
Single-phase corresponding index data carries out investigation processing empty value；Recording unit 210, for according to second judging unit 208
Judged result, record needed in all lists carry out investigation processing empty value list, with user in the database
List when being indexed inquiry, the list that automatic phasing is answered carries out investigation processing empty value.
In the technical scheme, carried out by pair data volume of the index data corresponding with each list and null value ratio
Analysis, can accurately determine the list for needing to carry out investigation processing empty value, and then cause in user to the list in database
When being indexed inquiry, it can automatically realize and be emptied to corresponding list and (investigate null value) processing, be effectively improved
Search efficiency.Simultaneously as be according to the retrieval information of user configuring carry out analyzing and processing, therefore also allow for according to
The demand at family is neatly configured to retrieval information, to meet the demand of different user.
In the above-mentioned technical solutions, it is preferable that also include：Creating unit 212, for the information according to all lists
The corresponding index data with each list, creates the title of each list and corresponding with each list
Index data relation table, to be analyzed by a pair index data corresponding with each list in the relation table,
It is determined that whether the index data corresponding with each list needs to carry out investigation processing empty value.
In the technical scheme, by creating the title of each list and the pass of the index data corresponding with each list
It is table, enabling the relation between the title and corresponding index data of list is clearly shown, while can also be easy to
The index data of list is analyzed one by one according to relation table.
In the above-mentioned technical solutions, it is preferable that also include：Connection establishment unit 214, for setting up and the database
Connection；The acquiring unit 202 specifically for, the connection establishment unit 214 determine with the database successful connection when,
Perform all lists obtained in the database, and the index data corresponding with each list operation.
In the above-mentioned technical solutions, it is preferable that also include：3rd judging unit 216, for judging and each list
Corresponding index data whether there is；First judging unit 204 in the 3rd judging unit 216 specifically for sentencing
In the presence of the fixed index data corresponding with each list, perform and judge the index data corresponding with each list
Data volume whether be more than the minimum data amount operation.
In the above-mentioned technical solutions, it is preferable that the computing unit 206 includes：Statistic unit 2062, for statistics and institute
State the data volume shared by the null value in the single-phase corresponding index data of either table；Execution unit 2064, for calculating and described
Data volume shared by null value in the corresponding index data of one list and with the single-phase corresponding index data of the either table
Ratio between data volume, to obtain and the ratio shared by the null value in the single-phase corresponding index data of the either table.
Technical scheme is described in detail below in conjunction with Fig. 3 to Fig. 7.
For problems of the prior art, index hit analysis in large database concept is detected the invention provides a kind of
Scheme, it is not only simple algorithm logic, but can provide raising performance field record, when database is inquired about in operation
When, automatic-discharging processing can be carried out to index field, improve search efficiency, performance ratio is improved up to 400% through Experimental Comparison
More than.
Wherein, the interface of analysis tool is as shown in figure 3, user can select type of database, data source, and fill in use
Name in an account book claims and user cipher, and can fill in the parameter such as table minimum data amount and maximum null value ratio.
Index hit analysis in detection large database concept according to an embodiment of the invention is described in detail below in conjunction with Fig. 4
Method.
As shown in figure 4, the method that index hit is analyzed in detection large database concept according to an embodiment of the invention, bag
Include：
Step 402, database connection is set up, analysis configuration file is read and (table in database is included in analysis configuration file
Minimum data amount and the maximum null value ratio that allows).
Step 404, judge whether successful connection, and judge that the analysis configuration file that user is set whether there is, if even
Connect failure or analysis configuration file is not present, then provide and point out and terminate；Otherwise, step 406 is performed.
Step 406, all index datas in acquirement database, the relation set up between table and corresponding index column, and
Circulation is analyzed each table.
Step 408, index is judged whether, if the index not performed, is exited；If so, then performing step
Rapid 410.
Step 410, searching loop performs corresponding table, obtains the magnitude of index data, such as passes through (Select Count
(*) from tablename) realize.
Step 412, judge whether data magnitude can reach the magnitude (i.e. table minimum data amount) that user is set, if reached
Less than then return to step 406 is to next table analysis；Otherwise step 414 is performed.
Step 414, the null value inspection of manipulative indexing row is performed, and is contrasted to calculate by the result with step 410
Null value proportion.
Step 416, the maximum null value ratio that the null value proportion calculated according to step 414 and user are set, judges whether
Meet emptying condition, if NO, then return to step 406 is to next table analysis；Otherwise step 418 is performed.
Step 418, inspection result is recorded in a text format, the entitled table name of file, content needs the row name emptied
With null value ratio value, foundation finishes rear return to step 406 to next table analysis.
After the index that traversal performs all tables, terminate.
As shown in figure 5, the device 500 that index hit is analyzed in detection large database concept according to an embodiment of the invention, bag
Include：
Data source is configured and Data connection module 502, is mainly used in disposition data source, drive connection database, and read
Take the retrieval information at family.
Operational analysis module 504, by the index of all tables of the database of acquirement, to obtain the table name and index of corresponding table
Row, so as to realize that circulation performs analyze data.
Judge module 506, is mainly used in the result currently obtained, and the data message of user's typing is contrasted, and whether see needs
Do emptying item processing.
As a result output module 508, for for the generation of qualified table using table name as filename, manipulative indexing and null value
Ratio is the file of content, is put into assigned catalogue.
It is unreasonable due to data distribution during the implementation result of the present invention is the utilization scene that existing user can be made complicated
Property caused by recall precision the problem of decline, can preferably provide recall precision by the present apparatus, be adapted to complicated big of relation
Database and mass data detection are used.
Technical scheme needs to be fitted to corresponding query execution in the later stage, below in conjunction with certain specific company
ERP system further describes specific implementation process of the present invention in software development.
Embodiment 1：
Inquiry on solid data in certain company's ERP system would generally use VOQuery<E extends
ISuperVO>Query pattern, in the process can be by increasing emptying condition.
, can be in VOQuery according to the characteristics of the ERP system<E extends ISuperVO>Index column is read in middle increase
Method and emptying process can be increased in querying condition according to the result of feedback.
The pseudo-code example of algorithm is as follows：
Input：Wheresql, tablename (the where condition parts and database table name of query statement)；
Output：Wheresql with emptying sentence；
// definition column name array
List<String>CloumnName=new ArrayList<String>()；
// read corresponding index emptying path；
String billfilepath=this.readcloumnpath ()；
The corresponding file path of // splicing, to search for respective file
String billfiletablepath=this.readjionfiletable ()；
// file is read according to corresponding path
File tablename=this.filereadLine (billfiletablepath)；
// judge with the presence or absence of emptying
If (tablename==null)
return；
// splicing emptying item processing
return this.addempty(wheresql,tablename)；
Above procedure is as shown in Figure 6.
As shown in fig. 6, the method for detecting index hit analysis in large database concept according to another embodiment of the invention,
Including：
Step 602, in VOQuery<E extends ISuperVO>Looked into inquiry according to incoming where conditions assembling
Ask SQL, now record queries table name.
Step 604, corresponding file is searched according to table name.
Step 606, judge that the corresponding file of table name whether there is, when in the absence of when terminate search, if there is correspondence text
Part, then perform step 608.
Step 608, index record row are got.
Step 610, if judge these need empty index column whether query SQL where conditions with the presence or absence of
In the absence of then terminating, otherwise, step 612 is performed.
Step 612, according in the presence of emptying process in row increase where conditions.
Embodiment 2：
If comprehensive various considerations may be not present in queries uses VOQuery<E extends ISuperVO>Look into
Ask, may result in emptying process can not work；So need to increase another example to illustrate processing method.Performing inquiry
When, it is often directly to spell SQL with developer to complete inquiry, such as sample SQL statement such as Fig. 7 in development process.
When needing grasp the key link word where conditions, such as method for query execution of NC systems handling this SQL,
BaseDAO.executeQuery(String sql,ResultSetProcessor processor)；Need in corresponding side
Corresponding SQL is parsed in method, algorithm is as follows：
1) when performing BaseDAO.executeQuery methods, keyword (from, join are parsed according to the SQL come into
Deng) obtain corresponding table name and corresponding alias；
2) corresponding file is searched according to table name；
3) judge that the corresponding file of table name whether there is, when in the absence of when terminate to search, if there is respective file, then after
Continuous next step；
4) index record row are got and add corresponding table alias, whether the index column that judging these needs to empty is inquiring about
In SQL, emptying process in where conditions is increased according to there are row.
The implementation result of the present invention is to make existing ERP system in the case of without modification, the various ropes of automatic adaptation
Draw treatment conditions, the configuration automatically according to user sets emptying index entry, improves search efficiency.
Technical scheme is described in detail above in association with accompanying drawing, and the present invention is proposed a kind of new to be carried out to list
Processing empty value scheme is investigated, can automatically and accurately realize and investigation processing empty value is carried out to corresponding list, effectively improve
Search efficiency.Meanwhile, neatly retrieval information can also be configured according to the demand of user, meet different user
Demand.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.
Claims (8)
1. a kind of method for carrying out investigating processing empty value to list, it is characterised in that including：
All lists in database, and the index data corresponding with each list in all lists are obtained, and
The retrieval information of user configuring is obtained, the retrieval packet is containing the corresponding minimum data amount of the index data and allows most
Big null value ratio；
For each list in all lists, judging the data volume of the index data corresponding with each list is
It is no to be more than the minimum data amount；
When the data volume of the single-phase corresponding index data of judgement and either table is more than the minimum data amount, calculate and described
The ratio shared by null value in the corresponding index data of one list；
Ratio and the maximum null value ratio according to shared by with the null value in the single-phase corresponding index data of the either table, judge
Whether need pair to carry out investigation processing empty value with the single-phase corresponding index data of the either table；
Record needed in all lists carry out investigation processing empty value list, with user to the list in the database
When being indexed inquiry, the list that automatic phasing is answered carries out investigation processing empty value；
Wherein, the step of calculating with the ratio shared by the null value in the single-phase corresponding index data of the either table specifically includes：
Statistics and the data volume shared by the null value in the single-phase corresponding index data of the either table；
Calculate and the data volume shared by the null value in the single-phase corresponding index data of the either table and single-phase with the either table
Ratio between the data volume of corresponding index data, to obtain and the null value in the single-phase corresponding index data of the either table
Shared ratio.
2. the method according to claim 1 for carrying out investigating processing empty value to list, it is characterised in that also include：
According to the information of all lists and the index data corresponding with each list, each list is created
The relation table of title and the index data corresponding with each list, with by pair with each list in the relation table
Corresponding index data is analyzed, it is determined that whether the index data corresponding with each list needs to carry out investigation sky
Value processing.
3. the method according to claim 1 for carrying out investigating processing empty value to list, it is characterised in that obtaining the number
Before the step of all lists in storehouse, in addition to：
Set up the connection with the database；
It is determined that during with the database successful connection, performing all lists obtained in the database, and with it is described every
The step of individual list corresponding index data.
4. it is according to claim 1 to list carry out investigate processing empty value method, it is characterised in that judge with it is described
Before the step of whether data volume of the corresponding index data of each list is more than the minimum data amount, in addition to：
Judge that the index data corresponding with each list whether there is；
In the presence of the index data corresponding with each list is judged, perform and judge corresponding with each list
The step of whether data volume of index data is more than the minimum data amount.
5. a kind of device for list investigate processing empty value, it is characterised in that including：
Acquiring unit, for obtaining all lists in database, and it is corresponding with each list in all lists
Index data, and for obtaining the retrieval information of user configuring, the retrieval packet is corresponding most containing the index data
Small data quantity and the maximum null value ratio allowed；
First judging unit, for judging that the data volume of the index data corresponding with each list in all lists is
It is no to be more than the minimum data amount；
Computing unit, for judging to be more than with the data volume of the single-phase corresponding index data of either table in first judging unit
During the minimum data amount, calculate and the ratio shared by the null value in the single-phase corresponding index data of the either table；
Second judging unit, for basis and the ratio shared by the null value in the single-phase corresponding index data of the either table and institute
Maximum null value ratio is stated, judges whether that needs pair carry out investigation processing empty value with the single-phase corresponding index data of the either table；
Recording unit, for the judged result according to second judging unit, record needs to be arranged in all lists
The list of processing empty value is looked into, with when user is indexed inquiry to the list in the database, the list that automatic phasing is answered
Carry out investigation processing empty value；
Wherein, the computing unit includes：
Statistic unit, for counting and the data volume shared by the null value in the single-phase corresponding index data of the either table；
Execution unit, for calculate with the data volume shared by the null value in the single-phase corresponding index data of the either table and with institute
The ratio between the data volume of the single-phase corresponding index data of either table is stated, to obtain and the single-phase corresponding index of the either table
The ratio shared by null value in data.
6. the device according to claim 5 for list investigate processing empty value, it is characterised in that also include：
Creating unit, for the information according to all lists and the index data corresponding with each list, is created
The relation table of the title of each list and the index data corresponding with each list, with by pair with the relation
The corresponding index data of each list in table is analyzed, it is determined that the index data corresponding with each list whether
Need to carry out investigation processing empty value.
7. the device according to claim 5 for list investigate processing empty value, it is characterised in that also include：Connection
Unit is set up, for setting up the connection with the database；
The acquiring unit is specifically for when the connection establishment unit is determined with the database successful connection, execution is obtained
Take all lists in the database, and the index data corresponding with each list operation.
8. the device according to claim 5 for list investigate processing empty value, it is characterised in that also include：3rd
Judging unit, the index data for judging corresponding with each list whether there is；
First judging unit is specifically for judging the index corresponding with each list in the 3rd judging unit
In the presence of data, perform and judge whether the data volume of the index data corresponding with each list is more than the minimum data
The operation of amount.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410784527.8A CN104462461B (en) | 2014-12-16 | 2014-12-16 | The method and device of investigation processing empty value is carried out to list |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410784527.8A CN104462461B (en) | 2014-12-16 | 2014-12-16 | The method and device of investigation processing empty value is carried out to list |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104462461A CN104462461A (en) | 2015-03-25 |
| CN104462461B true CN104462461B (en) | 2017-09-29 |
Family
ID=52908496
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410784527.8A Active CN104462461B (en) | 2014-12-16 | 2014-12-16 | The method and device of investigation processing empty value is carried out to list |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104462461B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358334B (en) * | 2017-05-25 | 2021-02-09 | 全球能源互联网研究院有限公司 | Data accuracy determination method, device, terminal and computer-readable storage medium |
| CN107870981B (en) * | 2017-09-30 | 2021-10-22 | 平安科技（深圳）有限公司 | Electronic device, data sheet filing method and storage medium |
| CN110019218B (en) * | 2017-12-08 | 2023-08-25 | 阿里巴巴集团控股有限公司 | Data storage and query method and equipment |
| CN107944058A (en) * | 2017-12-29 | 2018-04-20 | 安徽方正医疗信息技术有限公司 | The implementation method of the screening of big data quantity structural data and filtering based on webpage version |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102375852A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Method for building data index as well as method and system using data index for inquiring data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9110936B2 (en) * | 2010-12-28 | 2015-08-18 | Microsoft Technology Licensing, Llc | Using index partitioning and reconciliation for data deduplication |
-
2014
- 2014-12-16 CN CN201410784527.8A patent/CN104462461B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102375852A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Method for building data index as well as method and system using data index for inquiring data |
Non-Patent Citations (2)
| Title |
|---|
| Lossless recovery of a VQ index table with embedded secret data;Chin-Chen Chang 等;《visual communication & image representation》;20070123;第18卷(第2007期);第207页-216页 * |
| 索引替换策略在ERP缓存中的实现;赵振宇;《微处理机》;20090430(第2期);第82页-85页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104462461A (en) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230244673A1 (en) | Dynamic query processor for streaming and batch queries | |
| US11836148B1 (en) | Data source correlation user interface | |
| Beheshti et al. | A query language for analyzing business processes execution | |
| US7406477B2 (en) | Database system with methodology for automated determination and selection of optimal indexes | |
| CN102135938B (en) | Software product testing method and system | |
| US8463811B2 (en) | Automated correlation discovery for semi-structured processes | |
| US10769163B2 (en) | Cross-system nested journey monitoring based on relation of machine data | |
| CN104462461B (en) | The method and device of investigation processing empty value is carried out to list | |
| CN106294478A (en) | The data processing method of data warehouse and device | |
| CN103778185A (en) | SQL statement parsing method and system used for database auditing system | |
| US20100174701A1 (en) | Multi-column statistics usage within index selection tools | |
| US11481361B1 (en) | Cascading payload replication to target compute nodes | |
| US7761445B2 (en) | Automated system for identifying and dropping marginal database indexes | |
| US9846740B2 (en) | Associative search systems and methods | |
| CN103077192B (en) | A kind of data processing method and system thereof | |
| JP2012113706A (en) | Computer-implemented method, computer program, and data processing system for optimizing database query | |
| US20160034484A1 (en) | Document tagging and retrieval using entity specifiers | |
| US10671631B2 (en) | Method, apparatus, and computer-readable medium for non-structured data profiling | |
| De Renzis et al. | Semantic-structural assessment scheme for integrability in service-oriented applications | |
| CN102193859B (en) | Code analysis method and system | |
| Radulovic et al. | Extending software quality models-A sample in the semantic technologies domain | |
| CN109240926A (en) | A kind of software compatibility system safety testing device and method | |
| CN107729518A (en) | The text searching method and device of a kind of relevant database | |
| CN109934740B (en) | patent monitoring method and device | |
| Rozsnyai et al. | Automated correlation discovery for semi-structured business processes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100094 Haidian District North Road, Beijing, No. 68 Applicant after: Yonyou Network Technology Co., Ltd. Address before: 100094 Beijing city Haidian District North Road No. 68, UFIDA Software Park Applicant before: UFIDA Software Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |