CN112445787A - Data auditing method and system based on real-time service - Google Patents
Data auditing method and system based on real-time service Download PDFInfo
- Publication number
- CN112445787A CN112445787A CN202011310677.7A CN202011310677A CN112445787A CN 112445787 A CN112445787 A CN 112445787A CN 202011310677 A CN202011310677 A CN 202011310677A CN 112445787 A CN112445787 A CN 112445787A
- Authority
- CN
- China
- Prior art keywords
- auditing
- real
- data
- time
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000012550 audit Methods 0.000 claims abstract description 90
- 230000002159 abnormal effect Effects 0.000 claims abstract description 65
- 238000004458 analytical method Methods 0.000 claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 13
- 230000007547 defect Effects 0.000 claims description 17
- 238000005457 optimization Methods 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000003745 diagnosis Methods 0.000 claims description 5
- 238000013075 data extraction Methods 0.000 abstract description 6
- 230000000694 effects Effects 0.000 description 11
- 230000009286 beneficial effect Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 9
- 238000012384 transportation and delivery Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a data auditing method and system based on real-time service, and relates to the field of telecommunication service marketing. The method comprises the following steps: the method comprises the steps of collecting full service data, transmitting the service data through a preset method, receiving the service data and grouping the service data, inputting the grouped service data into a real-time auditing model configured according to preset auditing rules to audit in real time, outputting abnormal service data after auditing the service data is finished, storing the abnormal service data, realizing abnormal analysis and processing of multi-object service data, realizing easier data extraction, executing standard guarantee and improving the efficiency and accuracy of auditing work.
Description
Technical Field
The invention relates to the field of telecommunication service marketing, in particular to a data auditing method and system based on real-time service.
Background
In recent years, with the increase of flexibility and complexity of marketing service support systems in the telecommunication industry, the risk of loss of income of operators is increasing, and income guarantee becomes a focus of attention of the telecommunication industry. However, the incomes are lost due to the non-standardization and the leak of the business and the technology, the operation performance of the telecommunication enterprise is seriously influenced, and the benign continuous development of the enterprise is restricted.
Because the service range and the ordered data volume involved in the service audit are huge, the manual service audit mode has the defects of high data extraction difficulty, dispersed execution standards, low efficiency, low accuracy and the like.
Disclosure of Invention
The invention aims to solve the technical problem of the prior art and provides a data auditing method and system based on real-time service.
The technical scheme for solving the technical problems is as follows:
a data auditing method based on real-time service comprises the following steps: s1, collecting full service data;
s2, transmitting the service data by a preset method;
s3, receiving the service data and grouping;
s4, inputting the grouped business data into a real-time auditing model configured according to preset auditing rules to audit in real time;
and S5, outputting abnormal business data after the business data audit is finished, and storing the abnormal business data.
The invention has the beneficial effects that: the service data after grouping is input into the real-time auditing model configured according to the preset auditing rule to audit in real time, so that the abnormal analysis and processing of multi-object service data can be realized, the data extraction is easier, the execution is guaranteed to be standard, and the efficiency and the accuracy of auditing work are improved.
Further, the configuring the real-time auditing model according to the preset auditing rule specifically includes:
performing diagnosis and analysis according to the existing service data to obtain an audit object;
determining a business audit item according to the audit object;
and performing preset audit rule configuration on the service audit items to realize configuration of a real-time audit model, wherein the preset audit rules are set according to preset service logic.
The beneficial effect of adopting the further scheme is that: the scheme determines the service audit items according to the audit objects, and configures the preset audit rules for the service audit items to realize the configuration of a real-time audit model, so that the abnormal judgment and analysis of the multi-object service data can be realized through the model, for example, the accuracy of product configuration can be checked, abnormal data can be checked as early as possible, and the abnormal data can be corrected as soon as possible; the method can check whether the example user who orders the marketing service meets the handling condition; and the condition that the operation is not standardized by utilizing system bugs such as unauthorized use, channel crossing, job number limitation skipping, high-frequency transaction activities and the like of a salesman (or an electronic channel and the like) can be checked.
Further, the real-time auditing performed by the real-time auditing model configured according to the preset auditing rule specifically includes:
extracting target service data from the grouped service data;
performing text analysis processing on the target service data;
and auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
The beneficial effect of adopting the further scheme is that: the scheme performs real-time auditing on the analyzed target service data according to the real-time auditing model configured according to the preset auditing rule, and realizes real-time intelligent comprehensive assistance for auditing personnel to perform service monitoring.
Further, still include:
analyzing reasons according to the output abnormal business data;
and acquiring a service flow defect, and repairing abnormal service data of the service system according to the service flow defect.
The beneficial effect of adopting the further scheme is that: according to the scheme, the abnormal business data of the business system is repaired according to the business process defects, so that the business process and the business data are optimized, a more perfect business process is provided for enterprise development, the business performance of the enterprise is improved, and the benign continuous development of the enterprise is maintained.
Further, still include: and optimizing the preset auditing rule according to the reason analysis result of the abnormal service data, and updating the real-time auditing model according to the optimization result.
The beneficial effect of adopting the further scheme is that: according to the scheme, the preset auditing rule is optimized according to the reason analysis result of abnormal business data, the real-time auditing model is updated according to the optimization result, the model is continuously optimized, closed-loop management is formed, the real-time auditing model is more perfect, and real-time auditing can be more efficiently carried out.
Another technical solution of the present invention for solving the above technical problems is as follows:
a real-time service based data auditing system, comprising: the system comprises a data acquisition module, a data transmission module, a grouping module, a real-time auditing module and an abnormal output module;
the data acquisition module is used for acquiring full service data;
the data transmission module is used for transmitting the service data through a preset method;
the grouping module is used for receiving the service data and grouping the service data;
the real-time auditing module is used for inputting the grouped business data into a real-time auditing model configured according to preset auditing rules to carry out real-time auditing;
and the abnormal output module is used for outputting abnormal service data and storing the abnormal service data after the service data audit is finished.
The invention has the beneficial effects that: the service data after grouping is input into the real-time auditing model configured according to the preset auditing rule to audit in real time, so that the abnormal analysis and processing of multi-object service data can be realized, the data extraction is easier, the execution is guaranteed to be standard, and the efficiency and the accuracy of auditing work are improved.
Further, the real-time auditing module is specifically used for performing diagnosis and analysis according to the existing service data to obtain an auditing object;
determining a business audit item according to the audit object;
and performing preset audit rule configuration on the service audit items to realize configuration of a real-time audit model, wherein the preset audit rules are set according to preset service logic.
The beneficial effect of adopting the further scheme is that: the scheme determines the service audit items according to the audit objects, and configures the preset audit rules for the service audit items to realize the configuration of a real-time audit model, so that the abnormal judgment and analysis of the multi-object service data can be realized through the model, for example, the accuracy of product configuration can be checked, abnormal data can be checked as early as possible, and the abnormal data can be corrected as soon as possible; the method can check whether the example user who orders the marketing service meets the handling condition; and the condition that the operation is not standardized by utilizing system bugs such as unauthorized use, channel crossing, job number limitation skipping, high-frequency transaction activities and the like of a salesman (or an electronic channel and the like) can be checked.
Further, the real-time auditing module is further specifically configured to extract target service data from the grouped service data;
performing text analysis processing on the target service data;
and auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
The beneficial effect of adopting the further scheme is that: the scheme performs real-time auditing on the analyzed target service data according to the real-time auditing model configured according to the preset auditing rule, and realizes real-time intelligent comprehensive assistance for auditing personnel to perform service monitoring.
Further, still include: the repair module is used for analyzing reasons according to the output abnormal service data;
and acquiring a service flow defect, and repairing abnormal service data of the service system according to the service flow defect.
The beneficial effect of adopting the further scheme is that: according to the scheme, the abnormal business data of the business system is repaired according to the business process defects, so that the business process and the business data are optimized, a more perfect business process is provided for enterprise development, the business performance of the enterprise is improved, and the benign continuous development of the enterprise is maintained.
Further, still include: and the optimization module is used for optimizing the preset auditing rule according to the reason analysis result of the abnormal service data and updating the real-time auditing model according to the optimization result.
The beneficial effect of adopting the further scheme is that: according to the scheme, the preset auditing rule is optimized according to the reason analysis result of abnormal business data, the real-time auditing model is updated according to the optimization result, the model is continuously optimized, closed-loop management is formed, the real-time auditing model is more perfect, and real-time auditing can be more efficiently carried out.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic flowchart of a data auditing method based on real-time services according to an embodiment of the present invention;
fig. 2 is a block diagram of a data auditing system based on real-time services according to an embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth to illustrate, but are not to be construed to limit the scope of the invention.
As shown in fig. 1, a data auditing method based on real-time services provided in an embodiment of the present invention includes: s1, collecting full service data;
s2, transmitting the service data by a preset method; in certain embodiments, traffic data transfers may be handled in kafka messaging mode.
S3, receiving service data and grouping; where storm streaming can be used for packet processing.
S4, inputting the grouped service data into a real-time auditing model configured according to preset auditing rules to audit in real time;
and S5, outputting abnormal business data after the business data audit is finished, and storing the abnormal business data. In certain embodiments, the exception data store may employ a hbase non-relational database store.
In an embodiment, a data auditing method may include: collecting full-channel full-user ordering example data in real time; secondly, data transmission is carried out in a message mode, decoupling is carried out on the data transmission and the service system, processing is carried out independently, and data are grouped quickly; finally, according to the transaction rule audit items of the real-time audit model, the balance relation between example data related to businesses such as marketing activity, expense, volume classification, flow and payment data and the audit rule items is found, intelligent real-time audit is carried out on data business operations of an entity channel, an electronic channel and a universal channel, imbalance among the data is found timely and accurately, and abnormal positioning data are screened accurately;
in one embodiment, the balance or unbalance between the data may be determined according to a predetermined audit rule, wherein the predetermined audit rule may be set according to a predetermined service logic.
The scheme has the advantages that the grouped business data are input into the real-time auditing model configured according to the preset auditing rule to audit in real time, so that the abnormal analysis and processing of the multi-object business data can be realized, the data extraction is easier, the execution is guaranteed to be standard, and the efficiency and the accuracy of the auditing work are improved.
Preferably, in any of the above embodiments, configuring the real-time auditing model according to the preset auditing rule specifically includes:
performing diagnosis and analysis according to the existing service data to obtain an audit object;
determining a business audit item according to the audit object;
in an embodiment, may include: by carrying out diagnosis and analysis on the existing service support system and the service flow, the income loss point is searched in the service range, the key flow and data involved in the audit are combed, the audit object is determined, and the service audit item in the model is defined.
And performing preset audit rule configuration on the service audit project to realize configuration of the real-time audit model, wherein the preset audit rule is set according to preset service logic. In an embodiment, the configuration of the preset audit rule may be implemented by using coherence + local cache mode.
In one embodiment, the predetermined audit rule may be set according to the following: the whole life cycle audit items of several stages of pre-sale configuration, sale transaction, after-sale rule compliance and transaction termination can be obtained, and the related judgment logic can include:
the pre-sale logic 1, the transaction end time of the activity configuration must be greater than other absolute time point elements involved in the configuration data, such as delivery time, warranty time, and coupon time;
the logic 2 in the market, the handling marketing business must meet the specified antecedent constraints, namely the current attributes of the instance user, such as: main charge, additional charge, transaction times, target library, network access time and the like, which are matched with the prior item limiting conditions of the marketing service configuration, and the attributes of the transaction job number, such as a job number channel, a job number authority and the like, which are required to be matched with the attributes of the activity configuration;
selling logic 3, selling: the resources acquired by transacting the marketing service and the warranty fee must match, i.e., the resources that the instance user currently enjoys through the transaction service, such as: the premium, the preferential cost, the price and the like, and the guaranteed cost are matched with the resources configured by the marketing service and the guaranteed cost;
after-sale logic 4, the unsubscribe marketing service must meet the specified post-item constraints, namely attributes of the instance user when unsubscribing from the campaign, such as: tariff, etc., which must be matched to the antecedent constraints of the marketing service configuration;
after-sale logic 5, resources, such as delivery charges, that will not participate in the marketing service before enjoying the marketing service after unsubscribing the marketing service;
ending the transaction logic 6, the user status exception the resources and dead products enjoyed by the marketing service before the user will terminate can no longer be transacted, etc.
The scheme determines the service audit items according to the audit objects, and configures the preset audit rules for the service audit items to realize the configuration of the real-time audit model, and the model can realize the abnormal judgment and analysis of multi-object service data, for example, the accuracy of product configuration can be checked, abnormal data can be checked as soon as possible, and the abnormal data can be corrected as soon as possible; the method can check whether the example user who orders the marketing service meets the handling condition; and the conditions of nonstandard operation by using system bugs, such as unauthorized use, channel crossing, job number limitation skipping, high-frequency transaction activities and the like of a salesman or an electronic channel can be checked.
In a certain embodiment, in the aspect of configuration data, the real-time auditing model can be used for checking the accuracy of product configuration, and abnormal data of which the end time in the current system is less than the on-line time, the delivery time, the guarantee time, the binding charge end time, the discount time and the like can be checked as early as possible and corrected as soon as possible; for the failed or finished activities, whether the exception can be handled or not can be checked;
on one hand, in the aspect of example user data, whether example users who order marketing services meet handling conditions, such as main charge, additional charge, a target library, a group, network access time, handling times, whether the change charge meets upshifting and the like, can be checked; meanwhile, aiming at the user who removes the conflict activity, whether the user meets the limitation of the activity or not can be checked: if the appointed main charge is unsubscribed, the additional charge, the insurance bottom is unsuccessfully cancelled, the delivery charge and the delivery discount are successfully recovered, etc.; on the other hand, resources and the like enjoyed by marketing business before the user termination due to the abnormal user state can be audited. In the aspect of salesmen, the condition that the operation is not standardized by using system loopholes such as an unauthorized person, a channel crossing, a job number limitation skipping and a high-frequency transaction activity can be checked whether the conditions occur.
Preferably, in any of the above embodiments, the real-time auditing performed by the real-time auditing model configured according to the preset auditing rule specifically includes:
extracting target service data from the grouped service data;
performing text analysis processing on the target service data;
in an embodiment, the target service data may include three-party file service data, that is, configuration data, instance user data, and a salesman, wherein the parsing process may be performed by using flash.
And auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
The scheme performs real-time auditing on the analyzed target service data according to the real-time auditing model configured according to the preset auditing rule, and realizes real-time intelligent comprehensive assistance for auditing personnel to perform service monitoring.
Preferably, in any of the above embodiments, further comprising:
analyzing reasons according to the output abnormal business data;
and acquiring the service flow defect, and repairing the abnormal service data of the service system according to the service flow defect.
According to the scheme, the abnormal business data of the business system is repaired according to the business process defects, so that the business process and the business data are optimized, a more complete business process is provided for enterprise development, the business performance of the enterprise is improved, and the benign continuous development of the enterprise is maintained.
Preferably, in any of the above embodiments, further comprising: and optimizing the preset auditing rule according to the reason analysis result of the abnormal service data, and updating the real-time auditing model according to the optimization result.
According to the scheme, the preset auditing rule is optimized according to the reason analysis result of abnormal business data, the real-time auditing model is updated according to the optimization result, the model is continuously optimized, closed-loop management is formed, the real-time auditing model is more perfect, and real-time auditing can be more efficiently performed.
In one embodiment, as shown in fig. 2, a real-time service-based data auditing system includes: the system comprises a data acquisition module 11, a data transmission module 12, a grouping module 13, a real-time auditing module 14 and an exception output module 15;
the data acquisition module 11 is used for acquiring full service data;
the data transmission module 12 is configured to transmit the service data by a preset method;
the grouping module 13 is used for receiving the service data and grouping the service data;
the real-time auditing module 14 is used for inputting the grouped business data into a real-time auditing model configured according to preset auditing rules to carry out real-time auditing;
the abnormal output module 15 is used for outputting the abnormal service data after the service data audit is completed, and storing the abnormal service data.
The scheme has the advantages that the grouped business data are input into the real-time auditing model configured according to the preset auditing rule to audit in real time, so that the abnormal analysis and processing of the multi-object business data can be realized, the data extraction is easier, the execution is guaranteed to be standard, and the efficiency and the accuracy of the auditing work are improved.
Preferably, in any of the above embodiments, the real-time auditing module 14 is specifically configured to perform diagnostic analysis according to the existing service data to obtain an auditing object;
determining a business audit item according to the audit object;
and performing preset audit rule configuration on the service audit project to realize configuration of the real-time audit model, wherein the preset audit rule is set according to preset service logic.
The scheme determines the service audit items according to the audit objects, and configures the preset audit rules for the service audit items to realize the configuration of the real-time audit model, and the model can realize the abnormal judgment and analysis of multi-object service data, for example, the accuracy of product configuration can be checked, abnormal data can be checked as soon as possible, and the abnormal data can be corrected as soon as possible; the method can check whether the example user who orders the marketing service meets the handling condition; and the conditions of nonstandard operation by using system bugs, such as unauthorized use, channel crossing, job number limitation skipping, high-frequency transaction activities and the like, can also be checked by a salesman, an electronic channel and the like.
Preferably, in any of the above embodiments, the real-time auditing module 14 is further specifically configured to extract target business data from the grouped business data;
performing text analysis processing on the target service data;
and auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
The scheme performs real-time auditing on the analyzed target service data according to the real-time auditing model configured according to the preset auditing rule, and realizes real-time intelligent comprehensive assistance for auditing personnel to perform service monitoring.
Preferably, in any of the above embodiments, further comprising: the repair module is used for analyzing reasons according to the output abnormal service data;
and acquiring the service flow defect, and repairing the abnormal service data of the service system according to the service flow defect.
According to the scheme, the abnormal business data of the business system is repaired according to the business process defects, so that the business process and the business data are optimized, a more complete business process is provided for enterprise development, the business performance of the enterprise is improved, and the benign continuous development of the enterprise is maintained.
Preferably, in any of the above embodiments, further comprising: and the optimization module is used for optimizing the preset audit rule according to the reason analysis result of the abnormal service data and updating the real-time audit model according to the optimization result.
According to the scheme, the preset auditing rule is optimized according to the reason analysis result of abnormal business data, the real-time auditing model is updated according to the optimization result, the model is continuously optimized, closed-loop management is formed, the real-time auditing model is more perfect, and real-time auditing can be more efficiently performed.
It is understood that some or all of the alternative embodiments described above may be included in some embodiments.
It should be noted that the above embodiments are product embodiments corresponding to the previous method embodiments, and for the description of each optional implementation in the product embodiments, reference may be made to corresponding descriptions in the above method embodiments, and details are not described here again.
The reader should understand that in the description of this specification, reference to the description of the terms "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described method embodiments are merely illustrative, and for example, the division of steps into only one logical functional division may be implemented in practice in another way, for example, multiple steps may be combined or integrated into another step, or some features may be omitted, or not implemented.
The above method, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A data auditing method based on real-time service is characterized by comprising the following steps:
s1, collecting full service data;
s2, transmitting the service data by a preset method;
s3, receiving the service data and grouping;
s4, inputting the grouped business data into a real-time auditing model configured according to preset auditing rules to audit in real time;
and S5, outputting abnormal business data after the business data audit is finished, and storing the abnormal business data.
2. The method as claimed in claim 1, wherein the configuring the real-time auditing model according to the preset auditing rule specifically includes:
performing diagnosis and analysis according to the existing service data to obtain an audit object;
determining a business audit item according to the audit object;
and performing preset audit rule configuration on the service audit items to realize configuration of a real-time audit model, wherein the preset audit rules are set according to preset service logic.
3. The method as claimed in claim 1 or 2, wherein the real-time auditing according to the real-time auditing model configured according to the preset auditing rule includes:
extracting target service data from the grouped service data;
performing text analysis processing on the target service data;
and auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
4. The method for auditing data based on real-time services according to claim 1 or 2, characterized by further comprising:
analyzing reasons according to the output abnormal business data;
and acquiring a service flow defect, and repairing abnormal service data of the service system according to the service flow defect.
5. The method for auditing data based on real-time services according to claim 4, further comprising: and optimizing the preset auditing rule according to the reason analysis result of the abnormal service data, and updating the real-time auditing model according to the optimization result.
6. A data auditing system based on real-time services, comprising: the system comprises a data acquisition module, a data transmission module, a grouping module, a real-time auditing module and an abnormal output module;
the data acquisition module is used for acquiring full service data;
the data transmission module is used for transmitting the service data through a preset method;
the grouping module is used for receiving the service data and grouping the service data;
the real-time auditing module is used for inputting the grouped business data into a real-time auditing model configured according to preset auditing rules to carry out real-time auditing;
and the abnormal output module is used for outputting abnormal service data and storing the abnormal service data after the audit of all service data is finished.
7. The system of claim 6, wherein the real-time auditing module is configured to perform diagnostic analysis based on existing business data to obtain an audit object;
determining a business audit item according to the audit object;
and performing preset audit rule configuration on the service audit items to realize configuration of a real-time audit model, wherein the preset audit rules are set according to preset service logic.
8. The system according to claim 6 or 7, wherein the real-time auditing module is further configured to extract target service data from the grouped service data;
performing text analysis processing on the target service data;
and auditing the analyzed target service data in real time according to a real-time auditing model configured according to preset auditing rules.
9. The real-time service-based data auditing system according to claim 6 or 7, characterized by further comprising: the repair module is used for analyzing reasons according to the output abnormal service data;
and acquiring a service flow defect, and repairing abnormal service data of the service system according to the service flow defect.
10. The real-time service based data auditing system of claim 9 further comprising: and the optimization module is used for optimizing the preset auditing rule according to the reason analysis result of the abnormal service data and updating the real-time auditing model according to the optimization result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011310677.7A CN112445787A (en) | 2020-11-20 | 2020-11-20 | Data auditing method and system based on real-time service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011310677.7A CN112445787A (en) | 2020-11-20 | 2020-11-20 | Data auditing method and system based on real-time service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112445787A true CN112445787A (en) | 2021-03-05 |
Family
ID=74738123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011310677.7A Pending CN112445787A (en) | 2020-11-20 | 2020-11-20 | Data auditing method and system based on real-time service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112445787A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113381893A (en) * | 2021-06-08 | 2021-09-10 | 中国联合网络通信集团有限公司 | Method and system for auditing communication service data |
| CN113628024A (en) * | 2021-08-25 | 2021-11-09 | 国网河北省电力有限公司沧州供电分公司 | Financial data intelligent auditing system and method based on big data platform system |
| CN114048516A (en) * | 2022-01-13 | 2022-02-15 | 武汉烽火信息集成技术有限公司 | Data auditing method, device, equipment and storage medium based on loss data packet |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473643A (en) * | 2013-09-10 | 2013-12-25 | 北京思特奇信息技术股份有限公司 | Product management data auditing method and system for BOSS system |
| CN111340606A (en) * | 2018-11-30 | 2020-06-26 | 中国移动通信集团湖南有限公司 | Full-process income auditing method and device |
| CN111831683A (en) * | 2020-07-24 | 2020-10-27 | 北京思特奇信息技术股份有限公司 | Automatic auditing method and system based on dynamic extended scene matching |
-
2020
- 2020-11-20 CN CN202011310677.7A patent/CN112445787A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473643A (en) * | 2013-09-10 | 2013-12-25 | 北京思特奇信息技术股份有限公司 | Product management data auditing method and system for BOSS system |
| CN111340606A (en) * | 2018-11-30 | 2020-06-26 | 中国移动通信集团湖南有限公司 | Full-process income auditing method and device |
| CN111831683A (en) * | 2020-07-24 | 2020-10-27 | 北京思特奇信息技术股份有限公司 | Automatic auditing method and system based on dynamic extended scene matching |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113381893A (en) * | 2021-06-08 | 2021-09-10 | 中国联合网络通信集团有限公司 | Method and system for auditing communication service data |
| CN113628024A (en) * | 2021-08-25 | 2021-11-09 | 国网河北省电力有限公司沧州供电分公司 | Financial data intelligent auditing system and method based on big data platform system |
| CN114048516A (en) * | 2022-01-13 | 2022-02-15 | 武汉烽火信息集成技术有限公司 | Data auditing method, device, equipment and storage medium based on loss data packet |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107358340B (en) | A kind of project management system based on list of engineering | |
| CN112445787A (en) | Data auditing method and system based on real-time service | |
| KR102286415B1 (en) | Online and offline information analysis service system by lifecycle according to product life cycle | |
| CN104866484A (en) | Data processing method and device | |
| CN105303444A (en) | Automatic adaption system for financial products | |
| KR101703529B1 (en) | Market analysis service provision method in accordance with market analysis thereof | |
| CN103824177A (en) | Modular web-based ASP application for multiple products | |
| CN103236005A (en) | Detection, evaluation and prevention method for e-commerce risky payments | |
| CN113205402A (en) | Account checking method and device, electronic equipment and computer readable medium | |
| CN111833182A (en) | Method and device for identifying risk object | |
| KR101487090B1 (en) | System and method for managing companies | |
| CN114579087A (en) | Method and device for designing power customer service middlings | |
| CN112328868A (en) | Credit evaluation and credit granting application system and method based on information data | |
| CN111602157A (en) | Supplier supply chain risk analysis method | |
| WO2024119789A1 (en) | Fund releasing method and apparatus, and computer device and readable storage medium | |
| CN116450703B (en) | Data processing, statistics, node determination and modeling method and electronic equipment | |
| CN112749974A (en) | Transaction data processing method, device, equipment and storage medium | |
| US20080162273A1 (en) | System and method of tracking process for managing decisions | |
| CN110825609B (en) | Service testing method, device and system | |
| CN116228402A (en) | Financial credit investigation feature warehouse technical support system | |
| CN111369370B (en) | Evaluation list processing method, device, server and storage medium | |
| CN113393315A (en) | Loan customer recommendation method and system based on power supply chain data | |
| CN112862598A (en) | Channel information management method and device, electronic equipment and medium | |
| US20100100410A1 (en) | Systems and Methods for Ecological Evaluation and Analysis of an Enterprise | |
| CA2522764C (en) | Systems and methods for recovery audit scope determination |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |