CN113449160A - Intelligent data screening method, device, equipment and medium - Google Patents
Intelligent data screening method, device, equipment and medium Download PDFInfo
- Publication number
- CN113449160A CN113449160A CN202110734633.5A CN202110734633A CN113449160A CN 113449160 A CN113449160 A CN 113449160A CN 202110734633 A CN202110734633 A CN 202110734633A CN 113449160 A CN113449160 A CN 113449160A
- Authority
- CN
- China
- Prior art keywords
- data
- screening
- information
- target data
- sorting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012216 screening Methods 0.000 title claims abstract description 275
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000004873 anchoring Methods 0.000 claims description 19
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 16
- 238000004364 calculation method Methods 0.000 claims description 12
- 238000012163 sequencing technique Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims 1
- 238000007873 sieving Methods 0.000 claims 1
- 238000004904 shortening Methods 0.000 abstract 1
- 238000001914 filtration Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000002457 bidirectional effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
- G06F16/90344—Query processing by using string matching techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9035—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9038—Presentation of query results
Abstract
The invention discloses a method, a device, equipment and a medium for intelligently screening data, wherein the method comprises the following steps: and screening target data items matched with the preset character types from the stored data information, respectively sorting the data values contained in each target data item to obtain a data value sorting result of each target data item, judging whether the screening conditions input by the user are matched with the target data items, and screening the data information according to the screening conditions and the data value sorting results of the matched target data items to obtain the corresponding target data information if the screening conditions are matched with the target data items. The invention belongs to the technical field of data query, and can sort the data values of target data items before screening the data information, and screen the data information based on the data value sorting result of the target data items and the screening condition input by a user, thereby shortening the processing time between inputting the screening condition and obtaining the target data, and greatly improving the efficiency of screening the data information.
Description
Technical Field
The invention relates to the technical field of data query, belongs to an application scene of intelligently screening structured data information in a smart city, and particularly relates to a method, a device, equipment and a medium for intelligently screening data.
Background
With the development of information technology, data information recorded by paper pieces is gradually replaced by being recorded in an electronic form, corresponding data information can be processed more conveniently and corresponding processing results can be obtained based on the electronic recording form, and the data information is generally required to be screened in the process of processing the data information, and specific processing such as statistics, analysis and the like is carried out on the screened data information. In the process of screening data information, the conventional technical method usually sequentially judges whether each data information meets a corresponding condition and screens out data information meeting the condition, however, the technical method has low intelligent degree and cannot be applied in some application scenes, for example, the corresponding data information cannot be screened out from the data information according to a certain proportion, so that the efficiency of screening the data information is low. Therefore, the prior art method has the problem of low efficiency of screening the data information.
Disclosure of Invention
The embodiment of the invention provides a method, a device, equipment and a medium for intelligently screening data, and aims to solve the problem of low screening efficiency in the prior art for screening data information.
In a first aspect, an embodiment of the present invention provides an intelligent data screening method, which includes:
if the stored data information is received, screening out data items matched with preset character types from the data information as target data items;
respectively sorting the data values contained in each target data item according to a preset sorting rule to obtain a data value sorting result of each target data item;
if a screening condition input by a user is received, judging whether the screening condition is matched with a target data item in the data information;
and if the screening condition is matched with a target data item in the data information, performing data screening on the data information according to the screening condition and a data value sorting result of the matched target data item to obtain corresponding target data information.
In a second aspect, an embodiment of the present invention provides an intelligent data screening apparatus, which includes:
the target data item acquisition unit is used for screening out data items matched with preset character types from the data information as target data items if the stored data information is received;
the data value sorting result acquiring unit is used for respectively sorting the data values contained in each target data item according to a preset sorting rule to obtain a data value sorting result of each target data item;
the screening condition judging unit is used for judging whether the screening condition is matched with a target data item in the data information or not if the screening condition input by a user is received;
and the target data information acquisition unit is used for screening the data information according to the screening condition and the data value sorting result of the matched target data item to obtain the corresponding target data information if the screening condition is matched with the target data item in the data information.
In a third aspect, an embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor, when executing the computer program, implements the intelligent data screening method according to the first aspect.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, causes the processor to execute the intelligent data screening method according to the first aspect.
The embodiment of the invention provides a method, a device, equipment and a medium for intelligently screening data. And screening target data items matched with the preset character types from the stored data information, respectively sorting the data values contained in each target data item to obtain a data value sorting result of each target data item, judging whether the screening conditions input by the user are matched with the target data items, and screening the data information according to the screening conditions and the data value sorting results of the matched target data items to obtain the corresponding target data information if the screening conditions are matched with the target data items. By the method, the data values of the target data items can be sorted before the data information is screened, and the data information is screened based on the data value sorting result of the target data items and the screening condition input by the user, so that the processing time between the user inputting the screening condition and acquiring the target data is shortened, and the efficiency of screening the data information is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of an intelligent data screening method according to an embodiment of the present invention;
FIG. 2 is a schematic view of a sub-flow of an intelligent data screening method according to an embodiment of the present invention;
FIG. 3 is a schematic view of another sub-flow of the intelligent data screening method according to the embodiment of the present invention;
FIG. 4 is a schematic view of another sub-flow of the intelligent data screening method according to the embodiment of the present invention;
FIG. 5 is a schematic view of another sub-flow of the intelligent data screening method according to the embodiment of the present invention;
FIG. 6 is a schematic view of another sub-flow of the intelligent data screening method according to the embodiment of the present invention;
FIG. 7 is a schematic view of another sub-flow of the intelligent data screening method according to the embodiment of the present invention;
FIG. 8 is a schematic block diagram of an intelligent data screening apparatus according to an embodiment of the present invention;
FIG. 9 is a schematic block diagram of a computer device provided by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Referring to fig. 1, fig. 1 is a schematic flow chart of an intelligent data screening method according to an embodiment of the present invention; the intelligent data screening method is applied to a user terminal or a management server, the intelligent data screening method is executed through application software installed in the user terminal or the management server, and the user terminal is terminal equipment which can receive screening conditions input by a user to intelligently screen data information, such as a desktop computer, a notebook computer, a tablet computer or a mobile phone and the like; the management server is a server end capable of receiving the screening conditions sent by the user through the terminal device to intelligently screen the data information, such as a server constructed by an enterprise or a government department. As shown in fig. 1, the method includes steps S110 to S140. As shown in fig. 1, the method includes steps S110 to S140.
S110, if the stored data information is received, screening out data items matched with preset character types from the data information to serve as target data items.
And if the stored data information is received, screening out a data item matched with the preset character type from the data information as a target data item. The user terminal or the management server can receive the data information input by the user or the data information sent by other terminals and store the received data information. The stored data information may be structured data information, the structured data information is composed of a plurality of pieces of data, and the structured data information may include at least one data item, each piece of data includes a data value corresponding to each data item, for example, the stored data information may be a data table, an image pixel value, a numerical matrix, and the like. After the data information is stored, a target data item matched with a preset character type can be screened from data items contained in the data information, and the target data item is a data item which can be sorted and screened from the data information.
In one embodiment, as shown in FIG. 2, step S110 includes sub-steps S111 and S112.
S111, determining the character type corresponding to each data item according to the data value of each data item in the data information.
The character type of each data item can be determined according to the data value corresponding to each data item, specifically, a plurality of data values can be randomly acquired from the data values contained in each data item, the character types of the acquired data values are judged one by one, and the character types of the data items can be determined by integrating the character types of the data values contained in one data item.
For example, if a plurality of data values "363636", "607B 8B" and "FFEFD 5" are randomly obtained from the data values included in the data item "pixel value", the character type of the first data value is a number, the character type of the second data value is a number and a letter, the character type of the third data value is a number and a letter, and the character types of the three data values are integrated to obtain the character type of the data item "pixel value" as a number and a letter.
And S112, judging whether the character type of each data item is matched with the preset character type, and acquiring the data item matched with the preset character type as a target data item according to the judgment result.
Whether the character type of each data item is matched with a preset character type can be judged, and the data item matched with the preset character type is obtained as a target data item according to the judgment result, wherein the preset character type can be numbers, letters or numbers and letters.
For example, if the preset character type is a number, it may be sequentially determined whether the character type of each data item is a number type, and a data item whose character type is a number type is screened from the data items included in the data information as a target data item.
S120, respectively sorting the data values contained in each target data item according to a preset sorting rule to obtain a data value sorting result of each target data item.
And respectively sequencing the data values contained in each target data item according to a preset sequencing rule to obtain a data value sequencing result of each target data item. And each target data item correspondingly comprises a plurality of data values, and the number of the data values contained in each target data item is equal to the number of the data in the data information, so that the data values of the screened target data items can be sorted to obtain a data value sorting result corresponding to each target data item. The sorting rule comprises a frequency calculation formula, a sorting algorithm and an anchoring proportion.
In an embodiment, as shown in fig. 3, step S120 includes sub-steps S121, S122, S123 and S124.
And S121, calculating the data quantity contained in the data information according to the frequency calculation formula to obtain the corresponding cycle frequency.
The sorting rule includes a number calculation formula, and the corresponding cycle number can be determined based on the number calculation formula and the number of data included in the data information, where the number included in the data information is equal to the number of data values included in each target data item. Specifically, the number of times calculation formula can be represented by formula (1):
S＝[log2(r)]+1 (1)；
wherein, S is the calculated cycle number, r is the data quantity contained in the data information, and [ a ] represents the rounding calculation of the value of a.
For example, if the number of data included in a certain piece of data information is 13, r is 13, and the number of cycles S is 4, which can be calculated according to the above number calculation formula.
And S122, respectively executing a plurality of times of sorting processing corresponding to the cycle times on the data values contained in each target data item according to the sorting algorithm to obtain the data value sorting information of each target data item.
And acquiring a data value contained in each target data item, and performing a plurality of times of sorting processing on the data value contained in each target data item through a sorting algorithm according to the cycle number, wherein the cycle number is the number of times of executing the sorting algorithm in the process of sorting the data value contained in one target data item, and corresponding data value sorting information can be obtained after the plurality of times of sorting processing, and the data value contained in each target data item is respectively sorted, so that the data value sorting information corresponding to each target data item can be obtained. Wherein the sorting algorithm may be a two-way bubble algorithm.
In one embodiment, as shown in fig. 4, step S122 includes sub-steps S1221, S1222, S1223, S1224, S1225, and S1226. S1221 to S1226 are specific processes of sorting data values included in one target data item by using a bidirectional bubble algorithm.
S1221, arranging data values contained in the target data items to serve as an initial queue; s1222, sequentially comparing the sizes of two adjacent data values in the initial queue and placing the larger data value at the tail of the queue according to each comparison result to obtain a forward ordering queue; s1223, sequentially comparing the sizes of two adjacent data values in the forward sorting queue, and placing a smaller data value at the head of the queue according to each comparison result to obtain a reverse sorting queue; s1224, determining whether the number of execution times is not less than the number of cycles; s1225, if the execution time is less than the cycle time, taking the reverse sorting queue as an initial queue, and returning to execute the step of sequentially comparing the sizes of two adjacent data values in the initial queue and placing the larger data value at the tail of the queue according to the comparison result each time to obtain a forward sorting queue, that is, returning to execute step S1222; and S1226, if the execution times are not less than the cycle times, using the currently obtained reverse sorting queue as data value sorting information of the target data item. Compared with a common bubble sorting algorithm, the bidirectional bubble sorting algorithm adopted in the embodiment can greatly improve the efficiency of sorting processing.
And S123, acquiring corresponding anchoring value information from the data value sorting information of each target data item according to the anchoring proportion.
The sorting rule is further configured with an anchoring proportion, corresponding anchoring value information can be obtained from each piece of data value sorting information according to the anchoring proportion, the data value sorting information of each target data item can correspondingly obtain one piece of anchoring value information, the anchoring value information can be used for embodying a macro sorting condition of the data value sorting information, specifically, one piece of anchoring value information can comprise a plurality of anchoring values, and each anchoring value is a data value corresponding to one anchoring position of the data value sorting information. The corresponding anchor point position in each data sorting information can be determined according to the anchor ratio, and the corresponding anchor value information obtained by a plurality of anchor values in each data sorting information is obtained based on the anchor position.
For example, if the anchor point ratio is 1/5, the data values included in one piece of data value ranking information may be divided into five equal parts to obtain five anchor intervals, where the position corresponding to two adjacent data values in two adjacent anchor intervals is one anchor position, and after the five equal parts, 4 anchor positions may be determined, two data values before and after the anchor position in the data value ranking information are obtained to perform average calculation, and the calculated average value is used as the anchor value corresponding to each anchor position, so that the anchor value information of the data value ranking information correspondingly includes 4 anchor values.
And S124, adding the anchor value information of each target data item to corresponding data value sorting information to obtain a data value sorting result of each target data item.
And correspondingly adding each anchor value into a data value sorting result corresponding to the anchor value information according to the anchor position of each anchor value in the anchor value information, and taking the data value sorting information added with the anchor value information as a corresponding data value sorting result, so that each piece of data value sorting information can correspondingly obtain a data value sorting result after the anchor value information is added.
S130, if the screening condition input by the user is received, judging whether the screening condition is matched with the target data item in the data information.
And if the screening condition input by the user is received, judging whether the screening condition is matched with the target data item in the data information. A user can input screening conditions, the screening conditions comprise a screening item and corresponding screening information, the screening item is specific item information for screening the data information, whether the screening item in the screening conditions is matched with any one target data item can be judged, and if the screening item is matched with any one target data item, the screening conditions are judged to be matched with the target data item; otherwise, judging that the screening condition is not matched with the target data item.
If the screening condition is not matched with the target data item, sequentially judging whether each piece of data in the data information meets the screening condition according to the screening condition, and screening the data meeting the screening condition from the data information to serve as target data information and feeding back the target data information. If the screening condition is not matched with the target data item, the target data information can be screened from the data information only by adopting a common screening mode, namely whether the data value contained in each piece of data meets the screening condition is sequentially judged, and all pieces of data meeting the screening condition are obtained as corresponding target data information according to the judgment result of each piece of data.
S140, if the screening condition is matched with the target data item in the data information, performing data screening on the data information according to the screening condition and the data value sorting result of the matched target data item to obtain corresponding target data information.
And if the screening condition is matched with a target data item in the data information, performing data screening on the data information according to the screening condition and a data value sorting result of the matched target data item to obtain corresponding target data information and feeding back the target data information. The processing procedure of sorting the data values in the data information can be performed at any time before the data information is screened, and the data screening is performed on the basis of the data value sorting result obtained after the data value of the target data item is sorted, so that the efficiency of screening the data information can be greatly improved. If there is only one target data item matched with the screening condition, the data value sorting result of the target data item can be screened according to the screening condition to obtain the target data value in the data value sorting result, corresponding data is obtained from the data information according to the target data value and serves as target data information, feedback can be correspondingly performed after the target data information is obtained, and then the user can obtain the target data information corresponding to the screening condition.
In an embodiment, as shown in fig. 5, step S140 includes sub-steps S141, S142, S143, and S144.
And S141, judging whether the screening information of the screening condition is a screening threshold value.
The screening condition comprises screening information, whether the screening information is a screening threshold value or not can be judged, if the screening information is the screening threshold value, the data value sorting result of the target data item needs to be screened by adopting a threshold value screening mode; if the screening information is not threshold screening, it indicates that a proportional screening mode needs to be adopted to screen the data value sorting result of the target data item.
And S142, if the screening information of the screening condition is a screening threshold, screening the data values of the data value sorting results of the matched target data items according to the screening threshold to obtain the corresponding target data values.
If the screening information is a screening threshold, the data value sorting result of the target data item can be screened according to the screening threshold, and the screened data value is the target data value corresponding to the data value sorting result. The screening threshold includes corresponding symbols, the symbols represent screening directions corresponding to the data value screening, and the symbols may be ">", "<", "≧" or "≦ and the like.
For example, a certain filtering threshold may be represented as "> 45", wherein the symbol is ">", then the filtering direction of the filtering threshold is "greater", that is, a data value greater than 45 is obtained.
In one embodiment, as shown in FIG. 6, step S142 includes substeps S1421, S1422 and S1423.
S1421, determining an anchor interval corresponding to the screening threshold according to the anchor value information of the data value sorting result.
The screening threshold may be sequentially compared to the anchor values included in the anchor value information to determine the anchor interval in which the screening threshold is located. Specifically, the magnitude of the screening threshold is sequentially compared with the magnitude of the anchor values contained in the anchor value information, and two adjacent anchor values correspond to one anchor interval, so that one anchor interval containing the screening threshold in the numerical value intervals corresponding to the two anchor values can be determined as the anchor interval corresponding to the screening threshold according to the magnitude comparison result. If the screening threshold value obtained in the process of comparing the size of the screen is equal to a certain anchor value, the anchor position of the anchor value is directly determined as the screening position. Since the number of anchor values included in the anchor value information is much smaller than the total data amount of the data information, the anchor section corresponding to the filtering threshold value can be quickly determined based on the anchor value information.
S1422, determining the screening position of the screening threshold in the data value sorting result for the data value included in the anchor interval.
The screening threshold may be compared in turn with the data values contained in the anchor interval to determine the screening location of the screening threshold in the data value ranking results. Specifically, the magnitude of the screening threshold may be sequentially compared with the data values included in the anchor interval, and finally the screening position of the screening threshold in the data value sorting result is determined.
S1423, obtaining a corresponding data value from the data value sorting result according to the screening position and the symbol of the screening threshold value, and using the corresponding data value as the target data value.
And acquiring corresponding data values from the data value sorting result according to the screening positions and the signs of the screening threshold values to obtain corresponding target data values. For example, if the sign of the filtering threshold is ">", the corresponding data values in the sorting result of the data values are obtained downwards from the filtering position in sequence as the target data values, and the obtained data values do not include the data values equal to the filtering threshold; and if the sign of the screening threshold is less than or equal to, acquiring corresponding data values in the data value sorting result from the screening position upwards in sequence as target data values, wherein the acquired data values comprise data values equal to the screening threshold.
S143, if the screening information of the screening condition is not threshold screening, carrying out proportion interception from the data value sorting result of the matched target data item according to the screening proportion contained in the screening information to obtain a corresponding target data value.
If the screening information is not the screening threshold, the data value sorting result of the target data item can be proportionally intercepted according to the screening proportion contained in the screening information, and the intercepted data value is the target data value corresponding to the data value sorting result. The screening information includes a screening proportion and a screening direction, the screening proportion is a specific proportion value of the data values obtained from the data value sorting result, the screening direction is direction information corresponding to the data value screening, and the screening direction can be represented by + or-.
For example, a filter information of "+ 0.3" indicates that a data value ranked in the top and having a filter ratio of 0.3 is acquired as the corresponding target data value.
In an embodiment, as shown in fig. 7, step S143 includes sub-steps S1431 and S1432.
S1431, determining a corresponding interception position according to the screening proportion and the number of data values contained in the data value sorting result; s1432, obtaining a corresponding data value from the data value sorting result according to the interception position and the screening direction of the screening condition, and using the corresponding data value as the target data value.
And according to the determined intercepting position and the screening direction, intercepting a plurality of data values corresponding to the acquiring quantity from the intercepting position in the data value sorting result according to the screening direction to be used as target data values.
S144, obtaining data corresponding to the target data value from the data information as the target data information.
Because the target data value obtained by screening from the data value sorting result is only the data value corresponding to one target data item, that is, the target data value does not include all data values corresponding to one piece of data, the data corresponding to the target data value can be obtained from the data information as the target data information according to the data corresponding to the target data value, and then the target data includes all data values of the data corresponding to the target data value.
The technical method can be applied to scenes including intelligent screening of structured data information, such as intelligent government affairs, intelligent city management, intelligent community, intelligent security protection, intelligent logistics, intelligent medical treatment, intelligent education, intelligent environmental protection and intelligent traffic, and the like, so that the construction of a smart city is promoted.
In the intelligent data screening method provided by the embodiment of the invention, target data items matched with preset character types are screened from stored data information, data values contained in each target data item are respectively sorted to obtain a data value sorting result of each target data item, whether a screening condition input by a user is matched with the target data item is judged, and if the screening condition is matched with the target data item, the data information is screened according to the screening condition and the data value sorting result of the matched target data item to obtain corresponding target data information. By the method, the data values of the target data items can be sorted before the data information is screened, and the data information is screened based on the data value sorting result of the target data items and the screening condition input by the user, so that the processing time between the user inputting the screening condition and acquiring the target data is shortened, and the efficiency of screening the data information is greatly improved.
An embodiment of the present invention further provides an intelligent data screening apparatus, where the intelligent data screening apparatus is configured to execute any embodiment of the foregoing intelligent data screening method, and specifically, please refer to fig. 8, and fig. 8 is a schematic block diagram of the intelligent data screening apparatus provided in the embodiment of the present invention.
As shown in fig. 8, the intelligent screening apparatus 100 for data includes a target data item acquisition unit 110, a data value sorting result acquisition unit 120, a screening condition judgment unit 130, and a target data information acquisition unit 140.
And the target data item acquisition unit 110 is configured to, if the stored data information is received, screen out a data item matching the preset character type from the data information as a target data item.
In one embodiment, the target data item acquisition unit 110 includes sub-units: the character type determining unit is used for determining the character type corresponding to each data item according to the data value of each data item in the data information; and the character type judging unit is used for judging whether the character type of each data item is matched with the preset character type or not, and acquiring the data item matched with the preset character type as a target data item according to a judgment result.
The data value sorting result obtaining unit 120 is configured to sort the data values included in each target data item according to a preset sorting rule, so as to obtain a data value sorting result of each target data item.
In an embodiment, the data value sorting result obtaining unit 120 includes sub-units: the cycle number calculation unit is used for calculating the data quantity contained in the data information according to the number calculation formula to obtain the corresponding cycle number; a data value sorting information obtaining unit, configured to perform, according to the sorting algorithm, multiple sorting processes corresponding to the cycle times on the data values included in each target data item, respectively, to obtain data value sorting information of each target data item; the anchoring value information acquisition unit is used for acquiring corresponding anchoring value information from the data value sequencing information of each target data item according to the anchoring proportion; and the anchor value information adding unit is used for adding the anchor value information of each target data item into corresponding data value sorting information to obtain a data value sorting result of each target data item.
In one embodiment, the data value sorting information obtaining unit includes a sub-unit: an initial queue obtaining unit, configured to arrange data values included in the target data item as an initial queue; the forward ordering processing unit is used for sequentially comparing the sizes of two adjacent data values in the initial queue and placing a larger data value at the tail of the queue according to each comparison result to obtain a forward ordering queue; the reverse sorting processing unit is used for sequentially comparing the sizes of two adjacent data values in the forward sorting queue and placing a smaller data value at the head of the queue according to each comparison result to obtain a reverse sorting queue; an execution number judging unit for judging whether the execution number is not less than the cycle number; a return execution unit, configured to, if the execution time is less than the cycle time, use the reverse sorting queue as an initial queue and return to execute the step of sequentially comparing the sizes of two adjacent data values in the initial queue and placing a larger data value at the tail of the queue according to a comparison result of each time to obtain a forward sorting queue; and the sorting information acquisition unit is used for taking the currently obtained reverse sorting queue as the data value sorting information of the target data item if the execution times are not less than the cycle times.
A screening condition determining unit 130, configured to determine, if a screening condition input by a user is received, whether the screening condition matches a target data item in the data information.
And a target data information obtaining unit 140, configured to, if the screening condition is matched with a target data item in the data information, perform data screening on the data information according to the screening condition and a data value sorting result of the matched target data item, to obtain corresponding target data information.
In one embodiment, the target data information obtaining unit 140 includes sub-units: a screening information judgment unit configured to judge whether the screening information of the screening condition is a screening threshold; the data value screening unit is used for screening the data values of the data value sorting results of the matched target data items according to the screening threshold value if the screening information of the screening condition is the screening threshold value, so as to obtain the corresponding target data values; a data value intercepting unit, configured to, if the screening information of the screening condition is not threshold screening, perform proportional interception from the data value sorting result of the matched target data item according to a screening proportion included in the screening information, to obtain a corresponding target data value; a data acquisition unit configured to acquire data corresponding to the target data value from the data information as the target data information.
In one embodiment, the data value screening unit comprises a subunit: an anchor point interval determining unit, configured to determine, according to the anchor value information of the data value sorting result, an anchor point interval corresponding to the screening threshold; a screening position determining unit, configured to determine, for a data value included in the anchor interval, a screening position of the screening threshold in the data value sorting result; and the screening processing unit is used for acquiring a corresponding data value from the data value sorting result according to the screening position and the sign of the screening threshold value to serve as the target data value.
In one embodiment, the data value truncation unit includes a sub-unit: the intercepting position determining unit is used for determining a corresponding intercepting position according to the screening proportion and the number of data values contained in the data value sorting result; and the interception processing unit is used for acquiring a corresponding data value from the data value sequencing result according to the interception position and the screening direction of the screening condition to be used as the target data value.
The data intelligent screening device provided by the embodiment of the invention applies the data intelligent screening method, screens target data items matched with preset character types from stored data information, sorts data values contained in each target data item respectively to obtain a data value sorting result of each target data item, judges whether a screening condition input by a user is matched with the target data item, and screens the data information according to the screening condition and the data value sorting result of the matched target data item to obtain corresponding target data information if the screening condition is matched with the target data item. By the method, the data values of the target data items can be sorted before the data information is screened, and the data information is screened based on the data value sorting result of the target data items and the screening condition input by the user, so that the processing time between the user inputting the screening condition and acquiring the target data is shortened, and the efficiency of screening the data information is greatly improved.
The intelligent data screening device can be implemented in the form of a computer program, and the computer program can be run on a computer device as shown in fig. 9.
Referring to fig. 9, fig. 9 is a schematic block diagram of a computer device according to an embodiment of the present invention. The computer device may be a user terminal or a management server for executing the data intelligent screening method to intelligently screen the structured data information.
Referring to fig. 9, the computer device 500 includes a processor 502, memory, and a network interface 505 connected by a system bus 501, where the memory may include a storage medium 503 and an internal memory 504.
The storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032, when executed, may cause the processor 502 to perform the intelligent screening method, wherein the storage medium 503 may be a volatile storage medium or a non-volatile storage medium.
The processor 502 is used to provide computing and control capabilities that support the operation of the overall computer device 500.
The internal memory 504 provides an environment for the operation of the computer program 5032 in the storage medium 503, and when the computer program 5032 is executed by the processor 502, the processor 502 can be enabled to execute the data smart screening method.
The network interface 505 is used for network communication, such as providing transmission of data information. Those skilled in the art will appreciate that the configuration shown in fig. 9 is a block diagram of only a portion of the configuration associated with aspects of the present invention and is not intended to limit the computing device 500 to which aspects of the present invention may be applied, and that a particular computing device 500 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The processor 502 is configured to run the computer program 5032 stored in the memory to implement the corresponding functions in the above-mentioned intelligent data screening method.
Those skilled in the art will appreciate that the embodiment of a computer device illustrated in fig. 9 does not constitute a limitation on the specific construction of the computer device, and that in other embodiments a computer device may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. For example, in some embodiments, the computer device may only include a memory and a processor, and in such embodiments, the structures and functions of the memory and the processor are consistent with those of the embodiment shown in fig. 9, and are not described herein again.
It should be understood that, in the embodiment of the present invention, the Processor 502 may be a Central Processing Unit (CPU), and the Processor 502 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In another embodiment of the invention, a computer-readable storage medium is provided. The computer readable storage medium may be a volatile or non-volatile computer readable storage medium. The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the intelligent data screening method described above.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses, devices and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided by the present invention, it should be understood that the disclosed apparatus, device and method can be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only a logical division, and there may be other divisions when the actual implementation is performed, or units having the same function may be grouped into one unit, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a computer-readable storage medium, which includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned computer-readable storage media comprise: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. An intelligent data screening method is characterized by comprising the following steps:
if the stored data information is received, screening out data items matched with preset character types from the data information as target data items;
respectively sorting the data values contained in each target data item according to a preset sorting rule to obtain a data value sorting result of each target data item;
if a screening condition input by a user is received, judging whether the screening condition is matched with a target data item in the data information;
and if the screening condition is matched with a target data item in the data information, performing data screening on the data information according to the screening condition and a data value sorting result of the matched target data item to obtain corresponding target data information.
2. The intelligent data screening method of claim 1, wherein the screening out data items matching with a preset character type from the data information as target data items comprises:
determining a character type corresponding to each data item according to the data value of each data item in the data information;
and judging whether the character type of each data item is matched with the preset character type or not, and acquiring the data item matched with the preset character type as a target data item according to the judgment result.
3. The intelligent screening method of data according to claim 1, wherein the sorting rule includes a frequency calculation formula, a sorting algorithm, and an anchoring ratio, and the sorting of the data values included in each of the target data items according to a preset sorting rule to obtain a data value sorting result of each of the target data items includes:
calculating the data quantity contained in the data information according to the frequency calculation formula to obtain corresponding cycle frequency;
according to the sorting algorithm, performing multiple sorting processing corresponding to the cycle times on the data values contained in each target data item respectively to obtain data value sorting information of each target data item;
acquiring corresponding anchoring value information from the data value sequencing information of each target data item according to the anchoring proportion;
and adding the anchor value information of each target data item to corresponding data value sorting information to obtain a data value sorting result of each target data item.
4. The intelligent data screening method according to claim 3, wherein the sorting algorithm is a two-way bubble algorithm, and the obtaining the data value sorting information of each target data item by performing a plurality of sorting processes corresponding to the cycle times on the data values included in each target data item according to the sorting algorithm comprises:
arranging data values contained in the target data item to serve as an initial queue;
sequentially comparing the sizes of two adjacent data values in the initial queue and placing the larger data value at the tail of the queue according to each comparison result to obtain a forward sequencing queue;
sequentially comparing the sizes of two adjacent data values in the forward sorting queue and placing a smaller data value at the head of the queue according to each comparison result to obtain a reverse sorting queue;
judging whether the execution times are not less than the cycle times;
if the execution times are less than the cycle times, the reverse sorting queue is used as an initial queue, the steps of sequentially comparing the sizes of two adjacent data values in the initial queue and placing a larger data value at the tail of the queue according to the comparison result of each time are returned to execute, and a forward sorting queue is obtained;
and if the execution times are not less than the cycle times, taking the currently obtained reverse sorting queue as the data value sorting information of the target data item.
5. The intelligent data screening method according to claim 1, wherein the data screening the data information according to the screening condition and the data value sorting result of the matched target data item to obtain corresponding target data information includes:
judging whether the screening information of the screening condition is a screening threshold value;
if the screening information of the screening condition is a screening threshold, screening data values of the data value sorting results of the matched target data items according to the screening threshold to obtain corresponding target data values;
if the screening information of the screening condition is not threshold screening, carrying out proportion interception from the data value sorting result of the matched target data item according to the screening proportion contained in the screening information to obtain a corresponding target data value;
and acquiring data corresponding to the target data value from the data information as the target data information.
6. The intelligent data screening method of claim 5, wherein the data value screening of the data value sorting results of the matched target data items according to the screening threshold to obtain corresponding target data values comprises:
determining an anchor interval corresponding to the screening threshold according to the anchor value information of the data value sorting result;
determining the screening position of the screening threshold value in the data value sorting result for the data value contained in the anchoring interval;
and acquiring a corresponding data value from the data value sorting result according to the screening position and the symbol of the screening threshold value to be used as the target data value.
7. The intelligent data screening method of claim 5, wherein the obtaining of the corresponding target data value by performing proportional extraction from the data value sorting result of the matched target data item according to the screening proportion included in the screening information comprises:
determining a corresponding interception position according to the screening proportion and the number of data values contained in the data value sorting result;
and acquiring a corresponding data value from the data value sorting result as the target data value according to the interception position and the screening direction of the screening condition.
8. The utility model provides a data intelligence sieving mechanism which characterized in that includes:
the target data item acquisition unit is used for screening out data items matched with preset character types from the data information as target data items if the stored data information is received;
the data value sorting result acquiring unit is used for respectively sorting the data values contained in each target data item according to a preset sorting rule to obtain a data value sorting result of each target data item;
the screening condition judging unit is used for judging whether the screening condition is matched with a target data item in the data information or not if the screening condition input by a user is received;
and the target data information acquisition unit is used for screening the data information according to the screening condition and the data value sorting result of the matched target data item to obtain the corresponding target data information if the screening condition is matched with the target data item in the data information.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the intelligent screening method of data as claimed in any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, implements the intelligent data screening method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110734633.5A CN113449160A (en) | 2021-06-30 | 2021-06-30 | Intelligent data screening method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110734633.5A CN113449160A (en) | 2021-06-30 | 2021-06-30 | Intelligent data screening method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113449160A true CN113449160A (en) | 2021-09-28 |
Family
ID=77814409
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110734633.5A Pending CN113449160A (en) | 2021-06-30 | 2021-06-30 | Intelligent data screening method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113449160A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114334067A (en) * | 2022-03-10 | 2022-04-12 | 上海柯林布瑞信息技术有限公司 | Label processing method and device for clinical data |
| CN116227929A (en) * | 2023-03-07 | 2023-06-06 | 广州爱浦路网络技术有限公司 | Communication data analysis method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426569A (en) * | 2010-12-17 | 2012-04-25 | 百度在线网络技术（北京）有限公司 | Method and equipment for screening and sorting material data |
| CN102609473A (en) * | 2012-01-17 | 2012-07-25 | 钟进发 | Method and system for website accessing |
| CN102999601A (en) * | 2012-11-20 | 2013-03-27 | 广东欧珀移动通信有限公司 | Method for sorting files, and multimedia terminal |
| US20150112952A1 (en) * | 2013-10-17 | 2015-04-23 | Wistron Corporation | Method of data sorting |
| CN107729406A (en) * | 2017-09-25 | 2018-02-23 | 深圳达实智能股份有限公司 | A kind of data classification storage method and device |
| CN108228634A (en) * | 2016-12-15 | 2018-06-29 | 杭州华为数字技术有限公司 | A kind of data processing method and device |
| CN109064131A (en) * | 2018-07-24 | 2018-12-21 | 万翼科技有限公司 | Output method, server and the storage medium of real estate information |
| CN112084262A (en) * | 2020-09-04 | 2020-12-15 | 中国平安财产保险股份有限公司 | Data information screening method and device, computer equipment and storage medium |
-
2021
- 2021-06-30 CN CN202110734633.5A patent/CN113449160A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102426569A (en) * | 2010-12-17 | 2012-04-25 | 百度在线网络技术（北京）有限公司 | Method and equipment for screening and sorting material data |
| CN102609473A (en) * | 2012-01-17 | 2012-07-25 | 钟进发 | Method and system for website accessing |
| CN102999601A (en) * | 2012-11-20 | 2013-03-27 | 广东欧珀移动通信有限公司 | Method for sorting files, and multimedia terminal |
| US20150112952A1 (en) * | 2013-10-17 | 2015-04-23 | Wistron Corporation | Method of data sorting |
| CN108228634A (en) * | 2016-12-15 | 2018-06-29 | 杭州华为数字技术有限公司 | A kind of data processing method and device |
| CN107729406A (en) * | 2017-09-25 | 2018-02-23 | 深圳达实智能股份有限公司 | A kind of data classification storage method and device |
| CN109064131A (en) * | 2018-07-24 | 2018-12-21 | 万翼科技有限公司 | Output method, server and the storage medium of real estate information |
| CN112084262A (en) * | 2020-09-04 | 2020-12-15 | 中国平安财产保险股份有限公司 | Data information screening method and device, computer equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114334067A (en) * | 2022-03-10 | 2022-04-12 | 上海柯林布瑞信息技术有限公司 | Label processing method and device for clinical data |
| CN116227929A (en) * | 2023-03-07 | 2023-06-06 | 广州爱浦路网络技术有限公司 | Communication data analysis method, device, equipment and storage medium |
| CN116227929B (en) * | 2023-03-07 | 2024-03-19 | 广州爱浦路网络技术有限公司 | Communication data analysis method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113449160A (en) | Intelligent data screening method, device, equipment and medium | |
| CN108874289B (en) | Application history record viewing method and device and electronic equipment | |
| CN104572735B (en) | A kind of picture mark words recommending method and device | |
| CN111950723A (en) | Neural network model training method, image processing method, device and terminal equipment | |
| CN109685092B (en) | Clustering method, equipment, storage medium and device based on big data | |
| CN110874604A (en) | Model training method and terminal equipment | |
| CN106873857B (en) | Automatic application icon layout method and device | |
| CN105139282B (en) | A kind of power grid achievement data processing method, device and computing device | |
| CN109857893A (en) | Picture retrieval method, device, computer equipment and storage medium | |
| CN113642659A (en) | Training sample set generation method and device, electronic equipment and storage medium | |
| CN112102164A (en) | Image processing method, device, terminal and storage medium | |
| CN110717058A (en) | Information recommendation method and device and storage medium | |
| WO2022041188A1 (en) | Accelerator for neural network, acceleration method and device, and computer storage medium | |
| CN112035821A (en) | Method and device for identifying graphic verification code, computer equipment and storage medium | |
| CN111191651A (en) | Document image identification method and device, computer equipment and storage medium | |
| CN112149708A (en) | Data model selection optimization method and device, computer device and storage medium | |
| EP3200098A1 (en) | Methods and apparatus for comparing different types of data | |
| CN112836756A (en) | Image recognition model training method and system and computer equipment | |
| CN110674104A (en) | Feature combination screening method and device, computer equipment and storage medium | |
| CN110633304A (en) | Combination feature screening method and device, computer equipment and storage medium | |
| CN110826008A (en) | Index correlation analysis method and device, computer equipment and storage medium | |
| CN109684389A (en) | Conversion method, device, equipment and the readable storage medium storing program for executing of data list structure | |
| EP2093709A1 (en) | Document image feature value generating device, document image feature value generating method, and document image feature value generating program | |
| CN113688206A (en) | Text recognition-based trend analysis method, device, equipment and medium | |
| CN110533050B (en) | Picture geographic information acquisition method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |