CN107577743A - Financial settlement data processing method and device based on ETL - Google Patents

Financial settlement data processing method and device based on ETL Download PDF

Info

Publication number
CN107577743A
CN107577743A CN201710752509.5A CN201710752509A CN107577743A CN 107577743 A CN107577743 A CN 107577743A CN 201710752509 A CN201710752509 A CN 201710752509A CN 107577743 A CN107577743 A CN 107577743A
Authority
CN
China
Prior art keywords
order
financial settlement
verification
settlement data
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710752509.5A
Other languages
Chinese (zh)
Inventor
钟均全
李毅
黄承松
夏里峰
宋书俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Chimy Network Technology Co Ltd
Original Assignee
Wuhan Chimy Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Chimy Network Technology Co Ltd filed Critical Wuhan Chimy Network Technology Co Ltd
Priority to CN201710752509.5A priority Critical patent/CN107577743A/en
Publication of CN107577743A publication Critical patent/CN107577743A/en
Pending legal-status Critical Current

Links

Landscapes

  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

The embodiments of the invention provide a kind of financial settlement data processing method based on ETL and device, methods described to include:Financial settlement data corresponding to each order are carried out with correctness verification and reliability verification;For any order in current all orders, if financial settlement data are not verified by the correctness corresponding to any order, financial settlement data corresponding to any order are removed;If financial settlement data are verified by the correctness corresponding to any order, and do not verified by the reliability, label then is added for financial settlement data corresponding to any order, and correspondingly the financial settlement data with the label are loaded onto data warehouse by any order.By the way that financial settlement data are carried out with correctness verification and reliability verification, and financial settlement data are handled according to check results so that platform clearing are more efficiently and reliable.

Description

Financial settlement data processing method and device based on ETL
Technical field
The present embodiments relate to technical field of data processing, more particularly, to a kind of financial settlement number based on ETL According to processing method and processing device.
Background technology
ETL is to load the data of operation system afterwards by extracting (Extract), cleaning conversion (Transform) (Load) process of data warehouse is arrived, it is therefore an objective to by scattered, messy, the skimble-scamble Data Integration of standard in enterprise to together, The foundation of analysis is provided for the decision-making of enterprise.ETL is that BI (Business Intelligence, business intelligence) project is most important A link, under normal circumstances ETL can use up 1/3 time of whole project, ETL design quality be directly connected to BI items Purpose success or failure.ETL is also a long-term process, only constantly pinpoints the problems and solves problem, can just make ETL operational efficiency It is higher, provide accurate data for project later development.
ETL design divides three parts:Data pick-up (Extract), the cleaning conversion (Transform) of data, data Load (Load).Wherein, Extract:The extraction of data is to be drawn into ODS (Operational from each different data source Data Store, manipulation type data storage) in.Transform:Spend the time it is most long be cleaning conversion portion, ordinary circumstance This lower part workload is the 2/3 of whole ETL.And data cleansing is a process repeatedly, it is impossible to was completed in several days, only Have and constantly pinpoint the problems.Load:Data typically after data cleansing completion, are write direct DW (Data by the loading of data Warehouse, data warehouse) in.
At present, many shopping at network platforms are all handled financial settlement data using ETL, so that platform and businessman are pressed Cycle is settled accounts.But the existing technology handled using ETL financial settlement data, is turned to financial settlement data When changing cleaning, only done simple cleaning, cause later stage platform settle accounts in, easily occur clearing mistake, platform is caused through Ji loss.
The content of the invention
The embodiments of the invention provide it is a kind of overcome above mentioned problem or solve the above problems at least in part based on ETL Financial settlement data processing method and device.
On the one hand the embodiments of the invention provide a kind of financial settlement data processing method based on ETL, methods described bag Include:
Financial settlement data corresponding to each order are carried out with correctness verification and reliability verification;
For any order in current all orders, if financial settlement data do not pass through institute corresponding to any order Correctness verification is stated, then removes financial settlement data corresponding to any order;
If financial settlement data are verified by the correctness corresponding to any order, and do not pass through the reliability Verification, then label is added for financial settlement data corresponding to any order, and any order is corresponding with described The financial settlement data of label are loaded onto data warehouse.
Wherein, the correctness be verified as in following verification type at least any one, the following verification type is extremely Include order completeness check, the verification of the order amount of money and settling value verification less.
Wherein, the correctness is verified as order completeness check, described to financial settlement data corresponding to each order Correctness verification is carried out, is specifically included:
Verify whether the order commodity amount in financial settlement data corresponding to any order is more than zero, if being more than Zero, then pass through verification.
Wherein, the correctness is verified as the verification of the order amount of money, described that financial settlement data corresponding to each order are entered Row correctness verifies, and specifically includes:
The difference and order for verifying commodity total price and marketing expense total price in financial settlement data corresponding to any order are real Whether equal pay the amount of money, if equal, pass through verification.
Wherein, the correctness is verified as settling value verification, described that financial settlement data corresponding to each order are entered Row correctness verifies, and specifically includes:
When order clearing type settles accounts type for storage commodity in financial settlement data corresponding to any order, school Whether the value for testing settling value in financial settlement data corresponding to any order is not more than the half of commercial articles vending price, If being not more than, pass through verification.
Wherein, the reliability be verified as in following verification type at least any one, the following verification type is extremely Include span verification and business association verification less.
Wherein, the reliability is verified as span verification, described that financial settlement data corresponding to each order are entered Row reliability verifies, and specifically includes:
Verify the value of technical service fee ratio in financial settlement data corresponding to any order, Order Type takes Whether value, the after sale value of order subtype, the value of Order Type and the value of order status after sale are each self-corresponding In default span, if in each self-corresponding default span, pass through verification.
Wherein, the reliability is verified as business association verification, described to financial settlement data corresponding to each order Reliability verification is carried out, is specifically included:
It is whether related to delivery side's type to verify order clearing type in financial settlement data corresponding to any order Connection, and verify Order Type and order in financial settlement data corresponding to any order whether settle accounts type associated, if It is all associated, then pass through verification.
Wherein, order clearing type and delivery side's type in financial settlement data corresponding to the verification any order Whether be associated, and verify in financial settlement data corresponding to any order Order Type and order clearing type whether phase Association, is specifically included:
It is electric business platform to settle accounts type and delivery side's type when order clearing type for the commodity that put in storage, or, The Order Type is non-commodity clearing type and the delivery side type of putting in storage when being businessman, it is determined that the order clearing class Type is associated with delivery side's type;
When the Order Type is order on probation and order clearing type settles accounts type for the commodity that put in storage, it is determined that The Order Type is associated with order clearing type.
On the other hand the embodiments of the invention provide a kind of financial settlement data processing equipment based on ETL, described device Including:
Correction verification module, for financial settlement data corresponding to each order to be carried out with correctness verification and reliability verification;
Processing module, for for any order in current all orders, if finance knot corresponding to any order Count according to not verified by the correctness, then remove financial settlement data corresponding to any order;Any ordered if described Financial settlement data are verified by the correctness corresponding to list, and are not verified by the reliability, then any are ordered to be described Financial settlement data corresponding to list add label, and by financial settlement data corresponding to any order with the label It is loaded onto data warehouse.
A kind of financial settlement data processing method and device based on ETL provided in an embodiment of the present invention, by finance Financial settlement data are carried out correctness verification by the wash phase of settlement data and reliability verifies, and according to check results pair Financial settlement data are handled, and so as to remove the financial settlement data for influenceing clearing, while mark the finance that risk be present Settlement data so that platform clearing are more efficiently and reliable.
Brief description of the drawings
Fig. 1 is a kind of flow chart of the financial settlement data processing method based on ETL provided in an embodiment of the present invention;
Fig. 2 is a kind of structured flowchart of the financial settlement data processing equipment based on ETL provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention more remove, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is described with being purged, it is clear that described embodiment be the present invention Part of the embodiment, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not having The every other embodiment obtained under the premise of creative work is made, belongs to the scope of protection of the invention.
ETL design divides three parts in the embodiment of the present invention:Data pick-up, data conversion, data loading.Detailed process is such as Under be:
Business datum is extracted from multiple operation systems.
Wherein, the multiple operation system includes:Selling system, after sale system, supply chain system and marketing system etc..
Specifically, data pick-up is the process that data are extracted from data source.In practical application, the more use of data source It is relational database.Data are extracted from database typically has full dose to extract and increment extraction two ways.
Full dose extracts and is similar to Data Migration or data duplication, and it remains untouched the table in data source or the data of view Extracted from database, and be converted into the form that the instrument of oneself can identify, full dose extracts fairly simple.
The data for having increased newly or having changed in the table to be extracted in database since increment extraction is only drawn from last time extraction.Make During, increment extraction is wider compared with full dose extraction application, typically there is two point requirement accuracys to catching method, can be by business Delta data in system is accurately captured performance by certain frequency, it is impossible to too big pressure, shadow are caused to operation system Ring existing business.
The business datum is converted into the financial settlement data.
Specifically, the data extracted from data source not necessarily fully meet the requirement in purpose storehouse, such as data format Inconsistent, data entry error, data are imperfect etc., enter line number according to certain rule it is therefore desirable to the data to extracting According to conversion and processing.Rule mainly includes:
(1) directly map, it is exactly what that what, which is originally, remains untouched and indiscriminately imitates.
(2) field computing, one or more fields of data source perform mathematical calculations obtained aiming field, this rule For general logarithm value type-word section.
(3) with reference to conversion, generally it is used as reference major key by the use of one or more fields of data source in the transfer.
ETL transfer processes are typically all batch operation, it is necessary to handle following item well:
(1) metadata is to describe the data of data, main to include changing the rule of front and rear data structure and conversion every time. Metadata also includes the management of formal parameter, the parameter that the ETL units of formal parameter define, relatively also argument, and it is operation Shi Zhiding parameter, argument is not within the scope of metadata management.
(2) control of data flow will be defined the flow of correlation and flow monitoring by operator according to being actually needed Function.This is also the core for realizing service logic, even if using ripe tool software, this part is also required to by user Provided by visible process edit tool developed, and be monitored and test in the process of implementation.
(3) the definition method of transformation rule provides the common rule method of collection of functions, there is provided rules definition language description rule Then.
(4) quick indexing to data is typically all to utilize Hash technologies, and reference relation table is shifted to an earlier date into graftabl, is being turned This Hash table is searched when changing.
The conversion and processing of data can be carried out in ETL engines, and relation number can also be utilized in data extraction process Carried out simultaneously according to the characteristic in storehouse.Relational database has been provided for powerful SQL in itself, function supports the processing of data, such as Adding conditional is filtered in SQL query statement, and renaming field name is mapped with purpose table in inquiry, substr letters Number, case condition judgments etc..Compared to data conversion and processing is carried out in ETL engines, directly changed in SQL statement Simpler clear with processing, performance is higher.
Load data into data warehouse.
The best approach of loading data depends on the type of performed operation and needs that how many data loaded.Work as data bins When storehouse is relational database, in general there are two kinds of load modes:
(1) directly SQL statement carries out insert, update, delete operation.
(2) batch stowage is used, as bcp, bulk, the distinctive batch of relational database load instrument or api.
First method can be in most cases used, because they have carried out log recording and have been recoverable. In the embodiment of the present invention, the error type II data are loaded onto by the data warehouse using method in (1).
Fig. 1 is a kind of flow chart of the financial settlement data processing method based on ETL provided in an embodiment of the present invention, is such as schemed Shown in 1, methods described includes:Financial settlement data corresponding to each order are carried out correctness verification by S1 and reliability verifies; S2, for any order in current all orders, if financial settlement data corresponding to any order not by it is described just True property verification, then remove financial settlement data corresponding to any order;If financial settlement number corresponding to any order Verify according to by the correctness, and do not verified by the reliability, be then financial settlement number corresponding to any order According to plus label, and by any order, correspondingly the financial settlement data with the label are loaded onto data warehouse.
Wherein, financial settlement data source corresponding to each order is in selling system, front and rear system, form ordering system, marketing Multiple operation systems such as system and supply chain system.Financial settlement data corresponding to each order are by this multiple business Business datum corresponding with each order converts in system.During order generation, the business datum of each operation system Itself might have mistake, and business datum is being converted into might have mistake in financial settlement data procedures.So by wealth , it is necessary to be tested to financial settlement data before business settlement data deposit data warehouse, finance are tied further according to check results Count according to being handled.Usually, some influence final statement because mistake be present in financial settlement data, this kind of wealth Business settlement data needs to be eliminated;There are some not influence final statement, but risk be present, this kind of financial settlement data need depositing It is labeled before entering database to come out, so as to follow up check.
Specifically, in step sl, correctness is verified for finding to influence the financial settlement data settled accounts, reliability verification Exactly it is used to find the financial settlement data that risk be present.
In step s 2, for any one order, wherein include a plurality of financial settlement data, it is corresponding in this order A plurality of financial settlement data in, as long as there is a financial settlement data to influence final statement, then corresponding to this order All financial settlement data are not stored in data warehouse.In a plurality of financial settlement data corresponding to this order, Suo Youcai Business settlement data does not affect final statement, then all financial settlement data are all stored in data warehouse corresponding to this order; If but risky financial settlement data being wherein present, all financial settlement data corresponding to this order are in deposit data Before warehouse, label is all labeled with, so as to follow up check.
In checking procedure, to business system corresponding to the financial settlement data not verified by correctness verification or reliability System sends notice so that related service system can know wrong data in time, so that related service system is entered to wrong data Row is examined and the lookup of wrong data producing cause.
A kind of financial settlement data processing method based on ETL provided in an embodiment of the present invention, by financial settlement number According to wash phase, correctness verification and reliability are carried out to financial settlement data and verified, and finance are tied according to check results Count according to being handled, so as to remove the financial settlement data for influenceing clearing, while mark the financial settlement number that risk be present According to so that platform clearing are more efficiently and reliable.
Based on above-described embodiment, the correctness be verified as in following verification type at least any one, it is described following Verify type and comprise at least order completeness check, the verification of the order amount of money and settling value verification.
Wherein, the integrality of order, the order amount of money or settling value can influence final statement, then to financial settlement data When carrying out correctness verification, calculation rule can need to be examined according to the different demands that platform is settled accounts to set.For example, the correctness school Can only include in three kinds of verifications one is tested, two or three in three kinds of verifications can also be included.
Based on above-described embodiment, the correctness is verified as order completeness check, described to wealth corresponding to each order Business settlement data carries out correctness verification, specifically includes:
Verify whether the order commodity amount in financial settlement data corresponding to any order is more than zero, if being more than Zero, then pass through verification.
Specifically, if completeness check not by, it is zero to illustrate order commodity amount, or for sky, then this order without Method is settled accounts.
Based on above-described embodiment, the correctness is verified as the verification of the order amount of money, described to financial corresponding to each order Settlement data carries out correctness verification, specifically includes:
The difference and order for verifying commodity total price and marketing expense total price in financial settlement data corresponding to any order are real Whether equal pay the amount of money, if equal, pass through verification
Specifically, one kind that the verification of the order amount of money belongs in logical identities verification, if the verification of the order amount of money is not by meeting This order is caused to settle accounts mistake.
Based on above-described embodiment, the correctness is verified as settling value verification, described to financial corresponding to each order Settlement data carries out correctness verification, specifically includes:
When order clearing type settles accounts type for storage commodity in financial settlement data corresponding to any order, school Whether the value for testing settling value in financial settlement data corresponding to any order is not more than the half of commercial articles vending price, If being not more than, pass through verification.
Specifically, when order clearing type settles accounts type for storage commodity, in practical operation, commodity are delivered by platform, Warehousing costs, express fee etc. are so had, platform sets respective rule so that settling value is certainly less than commercial articles vending price It is general, and then ensure platform profit.
Based on above-described embodiment, the reliability be verified as in following verification type at least any one, it is described following Verify type and comprise at least span verification and business association verification.
Wherein, span or business association will not cause platform not settle accounts, if but financial settlement data not in phase The span answered, or relevance is unsatisfactory for requiring between business, then there may be the risk of clearing mistake.
Based on above-described embodiment, the reliability is verified as span verification, described to financial corresponding to each order Settlement data carries out reliability verification, specifically includes:
Verify the value of technical service fee ratio in financial settlement data corresponding to any order, Order Type takes Whether value, the after sale value of order subtype, the value of Order Type and the value of order status after sale are each self-corresponding In default span, if in each self-corresponding default span, pass through verification.
Based on above-described embodiment, the reliability is verified as business association verification, described to wealth corresponding to each order Business settlement data carries out reliability verification, specifically includes:
It is whether related to delivery side's type to verify order clearing type in financial settlement data corresponding to any order Connection, and verify Order Type and order in financial settlement data corresponding to any order whether settle accounts type associated, if It is all associated, then pass through verification.
Based on above-described embodiment, in financial settlement data corresponding to the verification any order order clearing type with Whether the side's of delivery type is associated, and verifies Order Type in financial settlement data corresponding to any order and settled accounts with order Whether type is associated, and specifically includes:
It is electric business platform to settle accounts type and delivery side's type when order clearing type for the commodity that put in storage, or, The Order Type is non-commodity clearing type and the delivery side type of putting in storage when being businessman, it is determined that the order clearing class Type is associated with delivery side's type;
When the Order Type is order on probation and order clearing type settles accounts type for the commodity that put in storage, it is determined that The Order Type is associated with order clearing type.
A kind of Fig. 2 structured flowcharts of the financial settlement data processing equipment based on ETL provided in an embodiment of the present invention, it is described Device includes:Correction verification module 1 and processing module 2.Wherein:
Correction verification module 1 is used to carry out correctness verification to financial settlement data corresponding to each order and reliability verifies. Processing module 2 is used for for any order in current all orders, if financial settlement data are not corresponding to any order Verified by the correctness, then remove financial settlement data corresponding to any order;If corresponding to any order Financial settlement data are verified by the correctness, and are not verified by the reliability, then for corresponding to any order Financial settlement data add label, and financial settlement data corresponding to any order with the label are loaded onto into number According to warehouse.
Specifically, for any one order, wherein including a plurality of financial settlement data, more corresponding to this order In bar financial settlement data, as long as there are a financial settlement data to influence final statement, then own corresponding to this order Financial settlement data are not stored in data warehouse.In a plurality of financial settlement data corresponding to this order, all finance knots Count according to final statement is not affected, then all financial settlement data are all stored in data warehouse corresponding to this order;But its Risky financial settlement data in if be present, all financial settlement data corresponding to this order are in deposit data warehouse Before, label is all labeled with, so as to follow up check.
In checking procedure, to business system corresponding to the financial settlement data not verified by correctness verification or reliability System sends notice so that related service system can know wrong data in time, so that related service system is entered to wrong data Row is examined and the lookup of wrong data producing cause.
A kind of financial settlement data processing equipment based on ETL provided in an embodiment of the present invention, by financial settlement number According to wash phase, correctness verification and reliability are carried out to financial settlement data and verified, and finance are tied according to check results Count according to being handled, so as to remove the financial settlement data for influenceing clearing, while mark the financial settlement number that risk be present According to so that platform clearing are more efficiently and reliable.
The embodiments of the invention provide a kind of computer program product, the computer program product is non-temporary including being stored in Computer program on state computer-readable recording medium, the computer program include programmed instruction, when described program instructs When being computer-executed, computer is able to carry out the method that above-mentioned each method embodiment is provided, such as including:To each order Corresponding financial settlement data carry out correctness verification and reliability verification;For any order in current all orders, if Financial settlement data are not verified by the correctness corresponding to any order, then remove wealth corresponding to any order Business settlement data;If financial settlement data are verified by the correctness corresponding to any order, and not by it is described can Verified by property, then add label for financial settlement data corresponding to any order, and any order is correspondingly carried The financial settlement data of the label are loaded onto data warehouse.
The embodiments of the invention provide a kind of non-transient computer readable storage medium storing program for executing, and the non-transient computer is readable to deposit Storage media stores computer instruction, and the computer instruction makes the computer perform the side that above-mentioned each method embodiment is provided Method, such as including:Financial settlement data corresponding to each order are carried out with correctness verification and reliability verification;For current institute There is any order in order, if financial settlement data are not verified by the correctness corresponding to any order, clearly Except financial settlement data corresponding to any order;If financial settlement data corresponding to any order pass through described correct Property verification, and do not verified by the reliability, then add label, and general for financial settlement data corresponding to any order Correspondingly the financial settlement data with the label are loaded onto data warehouse to any order.
Finally it should be noted that:The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that:It still may be used To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic; And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and Scope.

Claims (10)

1. a kind of financial settlement data processing method based on ETL, it is characterised in that methods described includes:
Financial settlement data corresponding to each order are carried out with correctness verification and reliability verification;
For any order in current all orders, if financial settlement data corresponding to any order not by it is described just True property verification, then remove financial settlement data corresponding to any order;
If financial settlement data are verified by the correctness corresponding to any order, and do not pass through the reliability school Test, then add label for financial settlement data corresponding to any order, and any order is correspondingly carried into the mark The financial settlement data of label are loaded onto data warehouse.
2. method according to claim 1, it is characterised in that the correctness is verified as at least appointing in following verification type Meaning is a kind of, and the following verification type comprises at least order completeness check, the verification of the order amount of money and settling value verification.
3. method according to claim 2, it is characterised in that the correctness is verified as order completeness check, described right Financial settlement data corresponding to each order carry out correctness verification, specifically include:
Verify whether the order commodity amount in financial settlement data corresponding to any order is more than zero, if more than zero, Pass through verification.
4. method according to claim 2, it is characterised in that the correctness is verified as the verification of the order amount of money, described to every Financial settlement data corresponding to individual order carry out correctness verification, specifically include:
The difference and order for verifying commodity total price and marketing expense total price in financial settlement data corresponding to any order pay gold in fact Whether volume is equal, if equal, passes through verification.
5. method according to claim 2, it is characterised in that the correctness is verified as settling value verification, described to every Financial settlement data corresponding to individual order carry out correctness verification, specifically include:
When order clearing type settles accounts type for storage commodity in financial settlement data corresponding to any order, institute is verified Whether the value for stating settling value in financial settlement data corresponding to any order is not more than the half of commercial articles vending price, if not It is more than, then passes through verification.
6. method according to claim 1, it is characterised in that the reliability is verified as at least appointing in following verification type Meaning is a kind of, and the following verification type comprises at least span verification and business association verification.
7. method according to claim 6, it is characterised in that the reliability is verified as span verification, described to every Financial settlement data corresponding to individual order carry out reliability verification, specifically include:
Verify the value of technical service fee ratio in financial settlement data corresponding to any order, the value of Order Type, Whether the value of the value of the value of order subtype, after sale Order Type and after sale order status is each self-corresponding default In span, if in each self-corresponding default span, pass through verification.
8. method according to claim 6, it is characterised in that the reliability is verified as business association verification, described right Financial settlement data corresponding to each order carry out reliability verification, specifically include:
It is whether associated with delivery side's type to verify order clearing type in financial settlement data corresponding to any order, and Whether associated Order Type and order clearing type in financial settlement data corresponding to any order are verified, if all related Connection, then pass through verification.
9. method according to claim 8, it is characterised in that financial settlement data corresponding to the verification any order Whether middle order clearing type is associated with delivery side's type, and verifies and ordered in financial settlement data corresponding to any order Whether single type and order clearing type are associated, specifically include:
It is electric business platform to settle accounts type and delivery side's type when order clearing type for the commodity that put in storage, or, it is described Order Type is non-commodity clearing type and the delivery side type of putting in storage when being businessman, it is determined that the order clearing type and Delivery side's type is associated;
When the Order Type is order on probation and order clearing type settles accounts type for the commodity that put in storage, it is determined that described Order Type is associated with order clearing type.
10. a kind of financial settlement data processing equipment based on ETL, it is characterised in that described device includes:
Correction verification module, for financial settlement data corresponding to each order to be carried out with correctness verification and reliability verification;
Processing module, for for any order in current all orders, if financial settlement number corresponding to any order According to not verified by the correctness, then financial settlement data corresponding to any order are removed;If any order pair The financial settlement data answered are verified by the correctness, and are not verified by the reliability, then are any order pair The financial settlement data answered add label, and financial settlement data corresponding to any order with the label are loaded To data warehouse.
CN201710752509.5A 2017-08-28 2017-08-28 Financial settlement data processing method and device based on ETL Pending CN107577743A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710752509.5A CN107577743A (en) 2017-08-28 2017-08-28 Financial settlement data processing method and device based on ETL

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710752509.5A CN107577743A (en) 2017-08-28 2017-08-28 Financial settlement data processing method and device based on ETL

Publications (1)

Publication Number Publication Date
CN107577743A true CN107577743A (en) 2018-01-12

Family

ID=61029720

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710752509.5A Pending CN107577743A (en) 2017-08-28 2017-08-28 Financial settlement data processing method and device based on ETL

Country Status (1)

Country Link
CN (1) CN107577743A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102355461A (en) * 2011-09-29 2012-02-15 广州中浩控制技术有限公司 XBRL (Extensible Business Reporting Language) credible data storage method and credible data storage system
CN105224542A (en) * 2014-05-30 2016-01-06 北京奇虎科技有限公司 A kind of method and apparatus business object data being imported platform
CN105787089A (en) * 2016-03-15 2016-07-20 国家电网公司 Power distribution network scheduling foundation data integrating method
US20160283935A1 (en) * 2014-07-06 2016-09-29 Visa International Service Association Dynamic checkout button apparatuses, methods and systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102355461A (en) * 2011-09-29 2012-02-15 广州中浩控制技术有限公司 XBRL (Extensible Business Reporting Language) credible data storage method and credible data storage system
CN105224542A (en) * 2014-05-30 2016-01-06 北京奇虎科技有限公司 A kind of method and apparatus business object data being imported platform
US20160283935A1 (en) * 2014-07-06 2016-09-29 Visa International Service Association Dynamic checkout button apparatuses, methods and systems
CN105787089A (en) * 2016-03-15 2016-07-20 国家电网公司 Power distribution network scheduling foundation data integrating method

Similar Documents

Publication Publication Date Title
US9652513B2 (en) Generating data pattern information
US8200614B2 (en) Apparatus and method to transform an extract transform and load (ETL) task into a delta load task
US20170109430A1 (en) Systems and methods for self-pairing databases
US20180144276A1 (en) System, method and apparatus for converting the business processes to test-centric activity diagrams
CN104636338B (en) A kind of data cleansing storage method for the monitoring of value-added tax negative and positive ticket
US9542456B1 (en) Automated name standardization for big data
US10579589B2 (en) Data filtering
CN104737187A (en) System and process of associating import and/or export data with a corporate identifier
CN108256113A (en) The method for digging and device of data genetic connection
CN112000656A (en) Intelligent data cleaning method and device based on metadata
Adams et al. Defining cases and variants for object-centric event data
CN111444073A (en) Method, device and system for testing performance of financial database
CN110706105A (en) Error marking method, error marking device, computer equipment and storage medium
CN105528447A (en) Method for rejecting and summarizing specific data layer by layer simultaneously
CN102208061A (en) Data cancel after verification processing device and method
CN106951913A (en) The method for carrying out data exchange, cloud platform and system
CN113420057A (en) Account checking data processing method and related device
US11188981B1 (en) Identifying matching transfer transactions
CN108897765A (en) A kind of batch data introduction method and its system
Dakrory et al. Automated ETL testing on the data quality of a data warehouse
CN109918385A (en) Tripartite's account checking method, electronic device and readable storage medium storing program for executing
CN107292549A (en) A kind of inventory monitoring methods and device
CN110188033B (en) Data detection device, method, computer device, and computer-readable storage medium
CN107016028A (en) Data processing method and its equipment
US20160148179A1 (en) Apparatus and method for monitoring transactions involving a conserved resource

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180112

RJ01 Rejection of invention patent application after publication