CN111400564B

CN111400564B - Data filtering method, system, equipment and medium

Info

Publication number: CN111400564B
Application number: CN202010211316.0A
Authority: CN
Inventors: 林畅
Original assignee: Inspur General Software Co Ltd
Current assignee: Inspur General Software Co Ltd
Priority date: 2020-03-24
Filing date: 2020-03-24
Publication date: 2023-06-27
Anticipated expiration: 2040-03-24
Also published as: CN111400564A

Abstract

The invention discloses a data filtering method, a system, equipment and a storage medium, wherein the method comprises the following steps: determining a filtering expression entity based on a data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not; responsive to the absence of a reference value corresponding to the filtered expression entity, obtaining the reference value based on the calculation and determining a calculated expression based on the reference value; generating a filter expression string based on the filter expression entity and the computational expression; and analyzing the filtering expression string to generate an expression, and filtering data in a database according to the expression. The method, the system, the equipment and the medium for filtering the data provided by the invention dynamically adjust the expression through the data entity object to be filtered, thereby realizing the dynamic filtering of the database data.

Description

Data filtering method, system, equipment and medium

Technical Field

The present invention relates to the field of data, and more particularly, to a method, a system, a computer device, and a readable medium for filtering data.

Background

With the continuous expansion of service functions and the arrival of big data age, accurate, efficient and rapid screening of data is increasingly important for the performance of the system. The common practice is to filter the data through the database interaction language splicing condition, and the method has no suitability of other types of databases, namely, the method is defined to be applicable to various databases at one time, and the filtering condition can not be constructed according to the real-time filtering requirement of a user on the data, so that how to dynamically and swiftly construct the filtering condition for interaction with the database becomes the focus of attention of a system developer.

Disclosure of Invention

Accordingly, an object of the embodiments of the present invention is to provide a method, a system, a computer device, and a computer readable storage medium for filtering data, which dynamically adjust an expression through a data entity object to be filtered, thereby implementing dynamic filtering of database data, and by creating the expression, writing of repeated codes can be reduced, which is beneficial to improving efficiency of data screening.

Based on the above objects, an aspect of the embodiments of the present invention provides a method for filtering data, including the following steps: determining a filtering expression entity based on a data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not; responsive to the absence of a reference value corresponding to the filtered expression entity, obtaining the reference value based on the calculation and determining a calculated expression based on the reference value; generating a filter expression string based on the filter expression entity and the computational expression; and analyzing the filtering expression string to generate an expression, and filtering data in a database according to the expression.

In some implementations, parsing the string of filtered expressions to generate an expression includes: and generating an expression template, and determining corresponding information in the expression template from the filtered expression string.

In some embodiments, the filtering the data in the database according to the expression further comprises: a plurality of the expressions are spliced to form a specification and data is filtered based on the specification.

In some embodiments, the determining a filtering expression entity based on the data entity object to be filtered comprises: and determining the data entity object to be filtered based on an object table in the database.

In another aspect of the embodiment of the present invention, there is also provided a system for filtering data, including: the entity module is configured to determine a filtering expression entity based on a data entity object to be filtered, and judge whether a reference value corresponding to the filtering expression entity exists or not; a calculation module configured to obtain a reference value based on calculation and determine a calculation expression based on the reference value in response to the absence of the reference value corresponding to the filtering expression entity; an execution module configured to generate a string of filter expressions based on the filter expression entity and the computational expression; and the filtering module is configured to parse the filtering expression string to generate an expression, and filter data in the database according to the expression.

In some embodiments, the filtration module is further configured to: and generating an expression template, and determining corresponding information in the expression template from the filtered expression string.

In some embodiments, the filtration module is further configured to: a plurality of the expressions are spliced to form a specification and data is filtered based on the specification.

In some embodiments, the entity module is further configured to: and determining the data entity object to be filtered based on an object table in the database.

In yet another aspect of the embodiment of the present invention, there is also provided a computer apparatus, including: at least one processor; and a memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method as above.

In yet another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the method steps as described above.

The invention has the following beneficial technical effects: the expression is dynamically regulated through the data entity object to be filtered, so that the dynamic filtering of database data is realized, and the writing of repeated codes can be reduced through creating the expression, thereby being beneficial to improving the efficiency of data screening.

Drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of an embodiment of a method for data filtering according to the present invention;

fig. 2 is a schematic hardware structure of an embodiment of a data filtering method provided by the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.

It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two entities with the same name but different entities or different parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention, and the following embodiments are not described one by one.

Based on the above object, in a first aspect of the embodiments of the present invention, an embodiment of a method for filtering data is provided. Fig. 1 is a schematic diagram of an embodiment of a method for filtering data provided by the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:

s1, determining a filtering expression entity based on a data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not;

s2, responding to the fact that no reference value corresponding to the filtering expression entity exists, obtaining a reference value based on calculation, and determining a calculation expression based on the reference value;

s3, generating a filter expression string based on the filter expression entity and the calculation expression; and

s4, analyzing the filtering expression strings to generate expressions, and filtering data in the database according to the expressions.

The conventional conditional query is generally realized through the sql (structured query statement) splicing condition, the query statement is unstable and variable and has no suitability, and the development of Expression enables a developer to operate a database by using an object, so that codes like common writing access databases are avoided, and the developer only needs to write the object. The protocol can realize the separation of query sentences and query conditions, the query sentences are stable and unchanged at the bottom layer, the query conditions are related to specific business and specific fields and are changeable, and a plurality of repeated codes can be reduced through the protocol, so that the final expansion of a program is facilitated.

And determining a filtering expression entity based on the data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not. In some embodiments, the determining a filtering expression entity based on the data entity object to be filtered comprises: and determining the data entity object to be filtered based on an object table in the database. For example, the data entity object to be filtered may be a human resource, and the filtering expression entity may be a person's height, age, or other data. The reference value is a critical value of data screening, and can be preset according to specific scenes.

In response to the absence of the reference value corresponding to the filtered expression entity, a reference value is derived based on the calculation and a calculated expression is determined based on the reference value. If the reference value is not preset, the corresponding reference value can be obtained according to calculation, and the calculation mode can be adjusted according to the filtering expression entity.

A filter expression string is generated based on the filter expression entity and the computational expression. For example, a string of filter expressions may be generated as follows:

String expression1＝"{\"expressItems\":["+"{\"propertyName\":\"id\",\"op erator\":4,\"expressType\":0,\"value\":\"100\",\"parentItem\":null},"+"{\"proper tyName\":\"code\",\"operator\":4,\"expressType\":0,\"value\":\"100_inspur_man ge\",\"parentItem\":null}],\"relationOperator\":0}"。

the string of filtered expressions is parsed to generate expressions, and data in the database is filtered according to the expressions. In some implementations, parsing the string of filtered expressions to generate an expression includes: and generating an expression template, and determining corresponding information in the expression template from the filtered expression string. For example, the expression template includes an attribute name, a comparison term, and a comparison value; and then sequentially finding out corresponding information from the filter expression string, and filling the found information into the corresponding position. The expression may be, for example: expression t=filter Expression Parse ParseCondition n < T > (filter Expression string).

In some embodiments, the filtering the data in the database according to the expression further comprises: a plurality of the expressions are spliced to form a specification and data is filtered based on the specification. The expression strings may be parsed into a reduced form for database interaction filtering by a filter expression parser in conjunction with a filtering entity. EF Core is an ORM (object relational mapping) which allows a developer to operate on a database using objects, avoiding code like ordinary writing access to the database, by just writing objects. The filtering condition analyzer combines the filtering entity analysis Expression string as Expression, and a plurality of expressions are spliced into a new Expression object to construct a general protocol of the entity framework, thereby realizing convenient and efficient screening of the entity data.

It should be noted that, in the foregoing embodiments of the data filtering method, the steps may be intersected, replaced, added and subtracted, so that the method of transforming the reasonable permutation and combination to the data filtering method should also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.

Based on the above object, a second aspect of the embodiments of the present invention provides a system for filtering data, including: the entity module is configured to determine a filtering expression entity based on a data entity object to be filtered, and judge whether a reference value corresponding to the filtering expression entity exists or not; a calculation module configured to obtain a reference value based on calculation and determine a calculation expression based on the reference value in response to the absence of the reference value corresponding to the filtering expression entity; an execution module configured to generate a string of filter expressions based on the filter expression entity and the computational expression; and the filtering module is configured to parse the filtering expression string to generate an expression, and filter data in the database according to the expression.

In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, determining a filtering expression entity based on a data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not; s2, responding to the fact that no reference value corresponding to the filtering expression entity exists, obtaining a reference value based on calculation, and determining a calculation expression based on the reference value; s3, generating a filter expression string based on the filter expression entity and the calculation expression; and S4, analyzing the filtering expression string to generate an expression, and filtering data in the database according to the expression.

Fig. 2 is a schematic hardware structure diagram of an embodiment of the data filtering method according to the present invention.

Taking the example of the apparatus shown in fig. 2, the apparatus includes a processor 301 and a memory 302, and may further include: an input device 303 and an output device 304.

The processor 301, memory 302, input device 303, and output device 304 may be connected by a bus or other means, for example in fig. 2.

The memory 302 is used as a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs, and modules, such as program instructions/modules corresponding to the methods of data filtering in the embodiments of the present application. The processor 301 executes various functional applications of the server and data processing, i.e., a method of implementing data filtering of the above-described method embodiments, by running nonvolatile software programs, instructions, and modules stored in the memory 302.

Memory 302 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the data filtering method, etc. In addition, memory 302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 302 may optionally include memory located remotely from processor 301, which may be connected to the local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 303 may receive input information such as a user name and a password. The output device 304 may include a display device such as a display screen.

Program instructions/modules corresponding to one or more methods of data filtering are stored in memory 302 that, when executed by processor 301, perform the methods of data filtering in any of the method embodiments described above.

Any one embodiment of a computer device that performs the above method of data filtering may achieve the same or similar effects as any one of the foregoing method embodiments corresponding thereto.

The invention also provides a computer readable storage medium storing a computer program which when executed by a processor performs the method as above.

Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the embodiments described above may be implemented by a computer program to instruct related hardware, and the program of the method for filtering data may be stored in a computer readable storage medium, where the program may include processes in the embodiments of the methods described above when executed. The storage medium of the program may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), or the like. The computer program embodiments described above may achieve the same or similar effects as any of the method embodiments described above.

Furthermore, the method disclosed according to the embodiment of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. The above-described functions defined in the methods disclosed in the embodiments of the present invention are performed when the computer program is executed by a processor.

Furthermore, the above-described method steps and system units may also be implemented using a controller and a computer-readable storage medium storing a computer program for causing the controller to implement the above-described steps or unit functions.

Further, it should be appreciated that the computer-readable storage medium (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of example, and not limitation, RAM may be available in a variety of forms such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP and/or any other such configuration.

The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general purpose or special purpose computer or general purpose or special purpose processor. Further, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, and the program may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.

Claims

1. A method of data filtering comprising the steps of:

determining a filtering expression entity based on a data entity object to be filtered, and judging whether a reference value corresponding to the filtering expression entity exists or not;

responsive to the absence of a reference value corresponding to the filtered expression entity, obtaining the reference value based on the calculation and determining a calculated expression based on the reference value;

generating a filter expression string based on the filter expression entity and the computational expression; and

analyzing the filtering expression string to generate an expression, and filtering data in a database according to the expression.

2. The method of claim 1, wherein parsing the string of filtered expressions to generate an expression comprises:

and generating an expression template, and determining corresponding information in the expression template from the filtered expression string.

3. The method of claim 1, wherein filtering the data in the database according to the expression further comprises:

a plurality of the expressions are spliced to form a specification and data is filtered based on the specification.

4. The method of claim 1, wherein the determining a filtering expression entity based on the data entity object to be filtered comprises:

and determining the data entity object to be filtered based on an object table in the database.

5. A system for data filtering, comprising:

the entity module is configured to determine a filtering expression entity based on a data entity object to be filtered, and judge whether a reference value corresponding to the filtering expression entity exists or not;

a calculation module configured to obtain a reference value based on calculation and determine a calculation expression based on the reference value in response to the absence of the reference value corresponding to the filtering expression entity;

an execution module configured to generate a string of filter expressions based on the filter expression entity and the computational expression; and

and the filtering module is configured to analyze the filtering expression string to generate an expression and filter data in the database according to the expression.

6. The system of claim 5, wherein the filter module is further configured to:

7. The system of claim 5, wherein the filter module is further configured to:

8. The system of claim 5, wherein the entity module is further configured to:

9. A computer device, comprising:

at least one processor; and

a memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method of any one of claims 1-4.

10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of any of claims 1-4.