CN114153868A

CN114153868A - Acquisition method and device for checking rule file, electronic equipment and storage medium

Info

Publication number: CN114153868A
Application number: CN202111455603.7A
Authority: CN
Inventors: 李志龙
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2021-12-01
Filing date: 2021-12-01
Publication date: 2022-03-08

Abstract

The application discloses a method and a device for acquiring a check rule file, electronic equipment, a storage medium and a program product, and relates to the technical field of mobile interconnection and automatic program design. The method comprises the following steps: displaying a check rule template corresponding to a check rule type according to the check rule type selected by a user, wherein the check rule template comprises at least one template element; acquiring a parameter value of each template element selected by the user; and compiling the checking rule template according to the at least one template element and the parameter value thereof to obtain a checking rule file corresponding to the checking rule type. The technical scheme of the application can effectively improve the configuration efficiency of the similar check rule, is convenient for a user to more intuitively and conveniently configure the check rule, effectively reduces the error rate of configuration and improves the configuration accuracy of the check rule.

Description

Acquisition method and device for checking rule file, electronic equipment and storage medium

Technical Field

The present application relates to the field of mobile internet and automatic programming technologies, and in particular, to a method and an apparatus for acquiring a check rule file, an electronic device, a storage medium, and a program product.

Background

With the opening of the big data era, the increase of the data concentration degree of the financial industry and the continuous development of the mobile internet technology, the banking industry faces unprecedented competitive pressure. Data has become an important asset for modern banks and is increasingly becoming an important component of modern bank core competitiveness. Effective data management and control work can revolutionarily influence business development, fine management and scientific decision of banks, and explicit business value is directly created for the banks. Meanwhile, the external supervision requirements are gradually increased, and the banking industry urgently needs to establish a data quality evaluation mechanism, deepen data management, continuously improve data quality and strengthen data service and data sharing.

At present, the design of data quality checking rules of various big banks emphasizes the technical angle, and a checking rule base is mainly designed and formed by checking a database table structure, a main key, a non-empty mode and the like. Although the method meets the requirements of data quality and management at that time to a certain extent, the manual workload of the method is large, the efficiency is low, and the error rate is high. Therefore, a more effective and accurate data quality check rule design method and thought need to be explored, a bank data quality check rule base is enriched, and the active defense capability of the bank data quality is improved.

Disclosure of Invention

The application provides a method and a device for acquiring a check rule file, electronic equipment, a storage medium and a program product, which aim to solve the problems of low efficiency and low accuracy in acquiring a data quality check rule in the prior art.

In a first aspect, the present application provides a method for acquiring a check rule file, where the method includes:

displaying a check rule template corresponding to a check rule type according to the check rule type selected by a user, wherein the check rule template comprises at least one template element;

acquiring a parameter value of each template element selected by the user;

and compiling the checking rule template according to the at least one template element and the parameter value thereof to obtain a checking rule file corresponding to the checking rule type.

In a second aspect, the present application further provides an apparatus for acquiring a rule file, where the apparatus includes:

the checking rule template display module is used for displaying a checking rule template corresponding to the checking rule type according to the checking rule type selected by a user, wherein the checking rule template comprises at least one template element;

a parameter value obtaining module, configured to obtain a parameter value of each template element selected by the user;

and the checking rule file acquisition module is used for compiling the checking rule template according to the at least one template element and the parameter value thereof to obtain a checking rule file corresponding to the checking rule type.

In a third aspect, the present application further provides an electronic device, including:

one or more processors;

a storage device for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement the method for retrieving the check rule file as described above.

In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the method for acquiring a check rule file as described above.

In a fifth aspect, the present application further provides a computer program product comprising a computer program, which when executed by a processor, implements the method for acquiring a check rule file as described above.

According to the technical scheme, a plurality of different types of check rule templates and template elements thereof are extracted in advance, so that a user can directly set the parameter values of the template elements through the check rule templates, configuration of check rules can be realized, and then a final check rule file can be obtained through unified compiling. Therefore, according to the method and the device, the check rule does not need to be manually established for each data table, the configuration efficiency of the check rule is effectively improved, a user can configure the check rule of the required type for any data table to be checked more intuitively and conveniently, the error rate of configuration is effectively reduced, and particularly, flexible definition of template elements is supported, so that flexible configuration of various check rules is realized.

Drawings

Fig. 1 is a flowchart of a method for acquiring a check rule file in a first embodiment of the present application;

fig. 2 is a flowchart of a method for acquiring a check rule file in the second embodiment of the present application;

fig. 3 is a schematic structural diagram of an apparatus for acquiring a check rule file in the third embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device in the fourth embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.

Example one

Fig. 1 is a flowchart of a method for acquiring a check rule file according to an embodiment of the present application, which is applicable to a case of generating a check rule file for checking data quality, and relates to the technical field of mobile interconnection and automatic programming. The method may be performed by an obtaining apparatus for checking the rule file, which may be implemented in software and/or hardware, and is preferably configured in an electronic device, such as a computer device or a server. As shown in fig. 1, the method specifically includes:

s101, displaying a check rule template corresponding to the check rule type according to the check rule type selected by a user, wherein the check rule template comprises at least one template element.

The checking rule type is obtained by combing the historical checking rules in advance and classifying the historical checking rules. For example, the checking rule types at least include index checking, table internal checking and table inter-association checking. Each checking rule type is correspondingly configured with a checking rule template, and the template comprises at least one template element for representing contents related to the checking rule of the type, such as a data table to be checked, a requirement on updating time of the data table, configuration of specific checking rules of different data table columns, and the like.

When the system is used, a user selects the check rule type first, and the system displays the corresponding check rule template according to the check rule type selected by the user so that the user can select and configure at least one template element on the template.

And S102, acquiring the parameter value of each template element selected by the user.

The user selects and configures at least one template element on the template, and the system can obtain the parameter value of each template element. For example, the parameter value of the data table to be checked may be a unique identifier of the data table; the parameter value of the data table updating time can be a specific number representing a time point or a time interval; and the rest can be analogized to other template elements, and the description is omitted here.

S103, compiling the check rule template according to at least one template element and the parameter value thereof to obtain a check rule file corresponding to the check rule type.

Each template element is used for representing the content of the check rule related to the check rule type selected by the user, so that after the parameter value of each template element is obtained, the parameter value is equivalent to the necessary information of the check rule of the type, and then the check rule file corresponding to the check rule type can be obtained by compiling the check rule template. According to the type of the database, the checking rule file can be a checking rule SQL statement, for example, and a system for executing data checking calls the checking rule file through a scheduling platform and executes the checking rule file, so that a final checking result can be obtained.

It should be noted that, in the prior art, usually, an examiner manually writes an SQL statement of an examination rule for each data table to be examined, which is not only inefficient, but also, because the same examination requirements often occur in the examination process of different data tables, the examiner still needs to write the examination rules for different data tables, which may cause many repetitive operations, further affecting the examination efficiency. In the technical scheme of the embodiment of the application, the checking rules which possibly appear are combed and summarized in advance to form the checking rule templates of various different types, so that a data quality checking person can generate corresponding checking rule files for data tables with the same checking requirements in a one-key mode directly through template configuration, the checking rules do not need to be written manually, batch checking can be realized, the reusability is high, and the checking efficiency is improved.

According to the technical scheme of the embodiment of the application, a plurality of different types of check rule templates and template elements thereof are extracted in advance, so that a user can configure the check rules by directly setting the parameter values of the template elements through the check rule templates, and then a final check rule file can be obtained through unified compiling. Therefore, according to the method and the device, the check rule does not need to be manually established for each data table, the configuration efficiency of the check rule is effectively improved, a user can configure the check rule of the required type for any data table to be checked more intuitively and conveniently, the error rate of configuration is effectively reduced, and particularly, flexible definition of template elements is supported, so that flexible configuration of various check rules is realized.

Example two

Fig. 2 is a flowchart of a method for acquiring a check rule file according to a second embodiment of the present application, and the present embodiment is further optimized based on the foregoing embodiments. As shown in fig. 2, the method includes:

s201, displaying a check rule template corresponding to the check rule type according to the check rule type selected by a user, wherein the check rule template comprises at least one template element.

In one embodiment, the template elements include a base element and a personality element. The basic elements are used for defining the set content of the checking rules corresponding to the checking rule types, and the individual elements are used for defining the self-defined content of the checking rules corresponding to the checking rule types and related to the current checking requirements of the user. That is, on the basis of meeting the common checking rules, the created template also has the function of customizing the checking rules by the user, and the user can customize the checking rules meeting the self-requirement through the template, so that the requirement of flexibly configuring the data quality checking rules is met.

S202, determining a current target data table to be checked according to the parameter value of the data table to be checked selected from the checking rule template by the user and the parameter value of the data table updating time.

Specifically, the template elements at least comprise a data table to be checked, data table updating time and checking rules. That is, it is necessary to configure, through the checking rule template, which data table is checked, and which time or time period of the data table is updated for the data, and what the specific checking rule is. The above can be achieved by configuring the parameter value of each template element in the check rule template.

In one embodiment, the parameter values of the template elements may be directly filled in by the user, or a list of alternatives may be displayed in advance and selected by the user. When the user selects the data table updating time and the data table to be checked, the target data table to be checked can be determined.

The number of the target data tables may be one or more. That is, because of the certain type of the checking rule defined by the checking rule template, the checking personnel only needs to determine the type of the checking rule according to the current data checking requirement, and then can select at least one target data table needing the type of data checking. Meanwhile, different checking rule parameter values can be configured for each target data table, and the same parameter value can also be configured, so that corresponding checking rules can be generated for a plurality of data tables simultaneously, configuration is more flexible, batch checking is realized, and checking efficiency is improved.

S203, displaying a list to be checked currently in the target data table according to the checking rule type of the checking rule template and the attribute information of each list in the target data table.

In general, any one data table may include a plurality of data columns, and the attributes of different data columns may be different, for example, table column data having a time attribute, table column data having an account detail attribute, table column data having a currency attribute, and the like. The embodiment of the application can realize the data quality check of the data columns with specific attributes in the data table.

Specifically, a list to be checked currently in the data table is displayed according to the checking rule type of the checking rule template and the attribute information of each list in the target data table, so that a user can select a list to be checked. The benefits of this are: on one hand, after the checking rule type is determined, the checking rule is equivalent to table list data which can determine which attribute is to be checked, for example, for the checking rule of the type of currency original currency code consistency, the checked table list data is usually the table list data of currency attributes, so that the table lists of the target data table can be automatically screened, and the table list corresponding to the checking rule type in the target data table is displayed according to the attribute information of each table list in the target data table, thereby accelerating the configuration of the checking rule by the user; on the other hand, the list columns with the same attribute in the target data table can be used as the current object to be checked through template configuration, so that batch checking is realized, and the checking efficiency is further improved. Of course, for the lists other than the displayed list, if there is a need for checking, the lists may be selected and configured in a customized manner, which is not limited in this embodiment of the present application.

S204, at least one target list to be checked currently selected from the list by the user is obtained, and the parameter value of the checking rule for checking each target list is obtained.

It should be noted that, for the at least one target table column, the same checking rule parameter value may be configured, and also different checking rule parameter values may be configured, so as to implement more flexible checking rule configuration according to the checking requirement.

S205, compiling the check rule template according to at least one template element and the parameter value thereof to obtain a check rule file corresponding to the check rule type.

According to the technical scheme of the embodiment of the application, a plurality of different types of check rule templates and template elements thereof are extracted in advance, so that a user can configure the check rules by directly setting the parameter values of the template elements through the check rule templates, and then a final check rule file can be obtained through unified compiling. Therefore, the check rule does not need to be manually established for each data table, and the configuration efficiency of the check rule is effectively improved. Meanwhile, the same or different checking rule parameters can be configured for a plurality of data tables and a plurality of tables in each data table, batch checking can be realized through one-time configuration, checking efficiency is further improved, and flexible configuration of various checking rules is also realized.

EXAMPLE III

Fig. 3 is a schematic structural diagram of an acquisition apparatus for checking a rule file in this embodiment. The embodiment can be suitable for the condition of generating the checking rule file for checking the data quality, and relates to the technical field of mobile interconnection and automatic programming. The device can realize the method for acquiring the check rule file in any embodiment of the application. As shown in fig. 3, the apparatus specifically includes:

the checking rule template display module 301 is configured to display a checking rule template corresponding to a checking rule type selected by a user, where the checking rule template includes at least one template element;

a parameter value obtaining module 302, configured to obtain a parameter value of each template element selected by the user;

and the checking rule file obtaining module 303 is configured to compile the checking rule template according to the at least one template element and the parameter value thereof, so as to obtain a checking rule file corresponding to the type of the checking rule.

Optionally, the template element at least includes a to-be-checked data table, a data table update time, and a check rule.

Optionally, the parameter value obtaining module 302 includes:

the target data table determining unit is used for determining the current target data table to be checked according to the parameter value of the data table to be checked selected from the checking rule template by the user and the parameter value of the data table updating time;

the list display unit is used for displaying a list to be checked currently in the target data table according to the checking rule type of the checking rule template and the attribute information of each list in the target data table;

and the checking rule parameter value acquisition unit is used for acquiring at least one target list to be checked currently selected from the list by the user and the parameter value of the checking rule for checking each target list.

Optionally, the number of the target data tables is at least one.

Optionally, the check rule types at least include index check, table internal check and inter-table association check.

Optionally, the template element includes a basic element and a personality element; the basic element is used for defining the setting content of the checking rule corresponding to the checking rule type; the personality elements are used for defining custom content of the checking rules which are related to the current checking requirements of the user and correspond to the type of the checking rules.

The device for acquiring the check rule file provided by the embodiment of the application can execute the method for acquiring the check rule file provided by any embodiment of the application, and has corresponding functional modules and beneficial effects of the execution method.

Example four

Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application. FIG. 4 illustrates a block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present application. The electronic device 12 shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

As shown in FIG. 4, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described herein.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with electronic device 12, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 via the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 16 executes various functional applications and data processing by running a program stored in the system memory 28, for example, to implement the method for acquiring the check rule file provided in the embodiment of the present application.

EXAMPLE five

The fifth embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for acquiring the check rule file according to the embodiment of the present application.

The computer storage media of the embodiments of the present application may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

In addition, an embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the method for acquiring a check rule file as described above.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. An acquisition method for checking a rule file is characterized by comprising the following steps:

acquiring a parameter value of each template element selected by the user;

2. The method of claim 1, wherein the template elements comprise at least a to-be-checked data table, a data table update time, and a check rule.

3. The method of claim 2, wherein said obtaining a parameter value for each of said template elements selected by said user comprises:

determining a target data table to be checked currently according to the parameter value of the data table to be checked selected from the checking rule template by the user and the parameter value of the data table updating time;

displaying a list to be checked currently in the target data table according to the checking rule type of the checking rule template and the attribute information of each list in the target data table;

and acquiring at least one target list to be checked currently selected from the list by the user and a parameter value of a checking rule for checking each target list.

4. The method of claim 1, wherein the number of target data tables is at least one.

5. The method according to claim 1, wherein the checking rule types include at least index checking, intra-table checking, and inter-table association checking.

6. The method of claim 1, wherein the template elements comprise a base element and a personality element; the basic element is used for defining the setting content of the checking rule corresponding to the checking rule type; the personality elements are used for defining custom content of the checking rules which are related to the current checking requirements of the user and correspond to the type of the checking rules.

7. An acquisition apparatus for checking a rule file, comprising:

8. An electronic device, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement a method of retrieving a collation rule file according to any one of claims 1 to 6.

9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of retrieving a collation rule file according to any one of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that the computer program realizes the method of retrieving a rule file according to any of claims 1-6 when executed by a processor.