CN107633015A - A kind of data processing method, device and equipment - Google Patents
A kind of data processing method, device and equipment Download PDFInfo
- Publication number
- CN107633015A CN107633015A CN201710728625.3A CN201710728625A CN107633015A CN 107633015 A CN107633015 A CN 107633015A CN 201710728625 A CN201710728625 A CN 201710728625A CN 107633015 A CN107633015 A CN 107633015A
- Authority
- CN
- China
- Prior art keywords
- operational indicator
- business
- deviation
- index
- verified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
This specification embodiment discloses a kind of data processing method, device and equipment, by obtaining the more parts of business datums from multiple data sources, corresponding monitoring decision system can generate corresponding operational indicator according to these business datums, and, the operational indicator for meeting practical business situation can be selected out from multiple operational indicators, for follow-up data analysis or service deployment.
Description
Technical field
The application is related to field of computer technology, more particularly to a kind of data processing method, device and equipment.
Background technology
Under some actual business scenarios, business provider is (such as：Website, bank, telecom operators etc.) may
It is monitored for the business datum generated by business service, such as：Total amount of withdrawing deposit in bank monitoring specified time section,
Total stroke count etc..Based on the monitoring to business datum, business provider can carry out data analysis, to optimize, to adjust related service,
Or implement corresponding operational decision making etc..
In the prior art, business provider is during the monitoring for business datum, it will usually introduces manual examination and verification
Link, specifically, the business datum got is directed to by business personnel and audited.
Based on prior art, it would be desirable to a kind of significantly more efficient data processing method.
The content of the invention
This specification embodiment provides a kind of data processing method, device and equipment, a kind of significantly more efficient to provide
Data processing method.
A kind of data processing method that this specification embodiment provides, including：
The business datum of identical services is obtained from different data sources；
For each business datum got, the business datum is handled, generates result；
Practical business index is determined in each result of generation.
A kind of data processing equipment that this specification embodiment also provides, including：
Acquisition module, the business datum of identical services is obtained from different data sources；
Processing module, for each business datum got, the business datum is handled, generation processing knot
Fruit；
Determining module, practical business index is determined in each result of generation.
A kind of data processing equipment that this specification embodiment also provides, including：
Memory, data storage processing routine；
Communication interface, receive business datum
Processor, the data processor stored in memory is called, and performed：
By the communication interface, the business datum of acquisition identical services from different data sources；
For each business datum got, the business datum is handled, generates result；
Practical business index is determined in each result of generation.
Above-mentioned at least one technical scheme that this specification embodiment uses can reach following beneficial effect：
Just because of more part business datums of the acquisition from multiple data sources, then, even if ought wherein certain part of business number
During according to occurring wrong, also error correction can be carried out using other business datums by the detection logic of setting, it is artificial without entering
The link of examination ＆ verification, while cost of labor is reduced, it also ensure that the accuracy of the operational indicator of generation.
In addition, the more parts of business datums got derive from different data sources, the business datum in different data sources is same
When the probability that malfunctions it is extremely low, it can thus be assumed that, using the data processing method in this specification embodiment, the data source of acquisition
Quantity is more, and the probability for the operational indicator error determined is lower, meanwhile, the operational indicator determined and actual business feelings
Deviation between condition is also just smaller.
Brief description of the drawings
Accompanying drawing described herein is used for providing further understanding of the present application, forms the part of the application, this Shen
Schematic description and description please is used to explain the application, does not form the improper restriction to the application.In the accompanying drawings：
Fig. 1 is the configuration diagram that the data processing method that this specification embodiment provides is based on；
Fig. 2 is the data handling procedure that this specification embodiment provides；
Fig. 3 is a kind of configuration diagram under practical business scene that this specification embodiment provides；
Fig. 4 is that two operation systems generate after carrying out business processing in a kind of application example that this specification embodiment provides
The schematic diagram of business datum；
Fig. 5 is the process schematic that the application example based on Fig. 4 determines practical business index；
Fig. 6 is the data processing equipment structural representation that this specification embodiment provides.
Embodiment
To make the purpose, technical scheme and advantage of the application clearer, below in conjunction with the application specific embodiment and
Technical scheme is clearly and completely described corresponding accompanying drawing.Obviously, described embodiment is only the application one
Section Example, rather than whole embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not doing
Go out under the premise of creative work the every other embodiment obtained, belong to the scope of the application protection.
In one or more embodiments in this manual, described data processing method can use as shown in Figure 1
Framework.At least it may include in Fig. 1：Operation system, business datum source and monitoring decision system.
Wherein, described operation system is regarded as the system that business provider backstage is used to provide different business service,
Such as：For providing the payment system of on-line payment function, form ordering system for providing order management function etc., in the industry of reality
In scene of being engaged in, the different business service that each operation system is provided can specifically use such as Enterprise SOA (Service-
Oriented Architecture, SOA) etc. business structure, here and be not especially limited.It should be noted that this specification
In embodiment, a complete business may be related to the business service in different operation systems, such as：When user is emitted in
After line transactional operation, the trading function in transaction system will be triggered, correspondingly, transaction system can further trigger billing and accounting system
Book keeping operation function, the account of both parties is realized, so as to complete online transaction.That is, for same business, it is different
Operation system may participate in the processing of the business, and generate corresponding business datum.Certainly, here only it is a kind of simple examples,
And it should not be used as the restriction to the application.
Described business datum source, it is believed that to be operation system generated after corresponding service logic is performed and industry
It is engaged in relevant data.Just it has been observed that for a complete business, the business clothes in its different business systems being related to
Business can generate corresponding business datum when performing service logic.Therefore, the business datum source in this specification embodiment,
It may include the business datum for coming from different business systems.
As a kind of feasible mode, the business datum of generation can be generally stored in corresponding Service Database, then,
Above-mentioned business datum source just may be considered different Service Databases.Described Service Database can use such as：Open
Put data processing service (Open Data Processing Service, ODPS) database, distributed data base
(Distributed Data Base, DDB), Hbase databases, MySQL database etc., are not especially limited here.
And it can also produce corresponding industry when performing service logic as another feasible mode, different business systems
Daily record be engaged in (such as：Log files), business diary can also be used as a kind of business datum.So business diary is also believed to a kind of industry
Business data source.Certainly, the restriction to the application is not formed here.
Described monitoring decision system, can be monitored to business datum, obtain corresponding operational indicator, and can be in portion
Separate service index is replaced when going wrong, and ensures the stability and accuracy of operational indicator.It can be wrapped in monitoring decision system
Containing single or concentrating type processing equipment, such as：Server, computer etc., it will specifically be disposed according to the needs of practical application
And setting.
It should be noted that the operational indicator described in this specification embodiment, it is believed that be to weigh business datum
A kind of quantative attribute, such as withdraw deposit total amount of the bank in a certain specified time section, total stroke count etc. in aforementioned exemplary, can conduct
Operational indicator.
Based on the framework shown in above-mentioned Fig. 1, the data processing method in this specification embodiment is as shown in Fig. 2 specific bag
Include following steps：
Step S201：The business datum of identical services is obtained from different data sources.
As can be known from Fig. 1, for same business, to complete the business, it may be necessary to different multiple business systems
System performs corresponding service logic.And when operation system is performing service logic, corresponding business record can be generated and be stored in
In Service Database, or, generation business diary is stored in business diary file.Based on this, can by Service Database and
Business diary file regards different data sources as, obtains business record therein and business diary as business datum.
It is understood that if data source is multiple, then, it also can just get the business datum of corresponding number.
On the basis of more parts of business datums are got, the possibility of follow-up business index error can be caused to reduce business datum error
Property.
Step S203：For each business datum got, the business datum is handled, generation processing knot
Fruit.
In this specification embodiment, the business datum that gets frequently with record form, in order to obtain corresponding finger
Mark, then need by summing, contrasting, hooking and the processing of mode such as check, so that generate can be as the result of operational indicator.
Such as：Assuming that it is as shown in table 1 below to get a business datum.
| Type of service | Paying party account | Beneficiary account | Amount | Time |
| Transaction payment | account A | account B | 100 | 18:00 |
| Transaction payment | account A | account B | 50 | 18:01 |
Table 1
Visible in table 1, this business data packet contains two transaction records, if index is statistics 18:00~18:05 this
Total transaction amount in one period, then need to calculate the summation of amount according to this two transaction records, i.e. 100+50=150.
Step S205：Practical business index is determined in each result of generation.
Specifically, it is contemplated that, may be because of system for partial service system in the application scenarios of reality
The reasons such as upgrading, system migration, cause data format, data structure of business datum etc. that a certain degree of change occurs.Herein
In the case of, if still using original processing logic, result may be caused inaccurate.
Continue to use aforementioned exemplary, it is assumed that transaction system when being stored to transaction record, adds " transaction by upgrading
This dimension of state ", and it is it is assumed that as shown in table 2 below for two transaction records in table 1, its stateful transaction.
| Type of service | Paying party account | Beneficiary account | Amount | Stateful transaction | Time |
| Transaction payment | account A | account B | 100 | Success | 18:00 |
| Transaction payment | account A | account B | 50 | Failure | 18:01 |
Table 2
As seen from Table 2, in the case, effective dealing money be 100, rather than it is foregoing be calculated 150.Cause
This, if using the foregoing total transaction amount (that is, result) calculated as operational indicator, then the operational indicator is inaccurate.
So, in the multiple results for just needing the business datum generation at more parts, determine to meet practical business situation
Practical business index.In one or more embodiments of this specification, corresponding detection logic can be used to multiple places
Manage result and carry out detection process, to select out practical business index.Wherein, described detection logic, it is believed that be a kind of detection
The judgment rule and error-correction rule whether above-mentioned result malfunctions, the restriction to the application should not be formed here.
By above-mentioned steps, for the above-mentioned data processing method in this specification embodiment, just because of acquisition
The more parts of business datums from multiple data sources, then, even if when wherein certain part of business datum occurs wrong, can also pass through
The detection logic of setting carries out error correction using other business datums, artificial reducing without entering the link of manual examination and verification
While cost, the accuracy of the operational indicator of generation also ensure that.
In addition, the more parts of business datums got derive from different data sources, the business datum in different data sources is same
When the probability that malfunctions it is extremely low, it can thus be assumed that, using the data processing method in this specification embodiment, the data source of acquisition
Quantity is more, and the probability for the operational indicator error determined is lower, meanwhile, the operational indicator determined and actual business feelings
Deviation between condition is also just smaller.
Based on foregoing teachings, in the business scenario of reality, the framework on business provider backstage is relative to the frame shown in Fig. 1
Structure, its composition are likely more complexity, and in a kind of more typical embodiment, its framework can be as shown in Figure 3.In figure 3 it can be seen that
Each data source corresponding to each operation system can be by the synchronizing traffic data wherein stored to sync database (such as：Hbase data
Storehouse) in, synchronous process can be realized by database query tools or database journal synchronization means, not make here specific
Limit.Business datum in sync database can generate corresponding operational indicator by processing system.Here processing system can
To be the server or server cluster with data processing function, after corresponding operational indicator is generated, business can be referred to
Mark is write to achievement data storehouse (such as：MySQL database).On this basis, monitoring decision system can be read in achievement data storehouse
The operational indicator of storage, and the operational indicator for meeting practical business situation by detecting logic to determine accordingly.
In above-mentioned framework, with reference to the data processing method in this specification embodiment, at the business datum
Reason, generate result, it is possible to including：For the business datum of each data source, according to the processing logic of setting to described
Business datum is handled, and generates candidate Traffic index, the result using the candidate Traffic index as generation.Wherein,
The processing logic of setting comprises at least：Summation process, average value processing and/or difference processing.Candidate Traffic index is just storable in
In achievement data storehouse as shown in Figure 3.
As it was previously stated, the part candidate Traffic index stored in achievement data storehouse there may be the phenomenon of error, so,
Monitoring decision system can be detected for candidate Traffic index, and to determine practical business index, its process is concretely：
In each candidate Traffic index of generation, a selected candidate Traffic index is selected, it is described to be verified as operational indicator to be verified, detection
Deviation between operational indicator and other candidate Traffic indexs, practical business index is determined according to the deviation.Wherein, the inspection
Survey comprises at least：Compare and/or hook and check.
Furthermore, practical business index is determined according to the deviation, it may include：
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs, will in setting range
The operational indicator to be verified is defined as practical business index；
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs exceeds setting range,
One is selected in other candidate Traffic indexs and selectes operational indicator to be verified, replaces original operational indicator to be verified, and according to replacement after
The deviation of operational indicator to be verified determine practical business index.
In addition, it can also be detected according to the type of the data source of operational indicator, specifically：If the business to be verified
Index and deviation between other alternative operational indicators of same type data source in setting range, and with from
Deviation between each alternative operational indicator in different types of data source exceeds setting range, then the operational indicator to be verified is true
It is set to practical business index.
If the operational indicator to be verified and the deviation between each alternative operational indicator of identical services system exist
In setting range, and and the deviation between each alternative operational indicator of other operation systems exceed setting range, then obtain
Take history contemporaneous data, generation refer to operational indicator, and with and this refer to the operational indicator of the deviation minimum between operational indicator
As practical business index.
Based on foregoing teachings, illustrated below by taking a kind of actual business scenario as an example.
Assuming that in this scenario, it is related to transaction system and billing and accounting system, as shown in Figure 4.Based on operation flow understand, when with
After family is traded, transaction system is kept accounts the book keeping operation function of triggering billing and accounting system.Transaction system can be in its database
Corresponding money transfer transactions record (trade_record) is recorded, it is as shown in table 3 below.
| Type of service | Paying party account | Beneficiary account | Amount | Stateful transaction | Time |
| Transaction payment | account A | account B | 100 | Success | 18:00 |
| Transaction payment | account A | account B | 100 | Failure | 18:01 |
Table 3
And billing and accounting system will receive corresponding Accounting Request, and record corresponding accounting data (transfer_
Request), it is as shown in table 4 below.
| Accounting-type | Type of service | Paying party account | Beneficiary account | Book keeping operation volume | Time |
| Standard is kept accounts | Transaction payment | account A | account B | 100 | 18:00 |
Table 4
In addition, each Accounting Request is directed in billing and accounting system, can all generate corresponding book keeping operation detail (Account_
Log), as shown in table 5.
| Accounting-type | Book keeping operation odd numbers | Account | Book keeping operation volume | Time |
| Standard is kept accounts | 100001 | account A | -100 | 18:00 |
| Standard is kept accounts | 100001 | account B | 100 | 18:01 |
Table 5
Above-mentioned 3~table of table 5 is regarded as the business datum from different data sources, specifically, in table 3 and table 4
Business datum can be originated from Service Database in transaction system and billing and accounting system, and the business datum of table 5 may originate at
The account daily record of billing and accounting system.
It is assumed herein that the operational indicator of required calculating is：In the period 18:00~18:Transaction limit between 10.That
, the processing system in Fig. 3 will be based on it is above-mentioned get business datum, calculate turnover/book keeping operation volume.According to different data sources
Business datum calculated after, corresponding operational indicator can be respectively obtained, for the ease of subsequent descriptions, herein by
The turnover that trade_record and transfer_request is calculated/book keeping operation volume, is designated as a1 and a2 respectively；It will pass through
The book keeping operation volume that Account_log is calculated is designated as a3.It can be seen that based on multiple data sources, multiple operational indicators can be calculated
(that is, above-mentioned a1~a3, these operational indicators are the above-mentioned alternative operational indicator referred to).
, can be with true using corresponding detection logic after monitoring decision system obtains above-mentioned operational indicator a1~a3
Surely the operational indicator to tally with the actual situation.
Specifically, flow as shown in Figure 5 can be used, namely：
Step S501：Monitoring decision system selects a selecting business index as practical business index to be determined.
In this specification embodiment, it will usually which prioritizing selection derives from the operational indicator in database, it is assumed herein that choosing
Operational indicator a1 is determined as practical business index (that is, the above-mentioned operational indicator to be detected referred to) to be determined.
Step S503：Judge deviation between selected operational indicator and other each operational indicators whether setting scope
It is interior, if so, then performing step S505 or S507；Otherwise, then step S509 is performed.
In other words, in this example, it will determine that the deviation between operational indicator a1 and a2, a3.It should be noted that just
In the case of often, a1~a3 value is typically identical.But consider in practical application, in Service Database and business diary
Business datum there may be a certain degree of deviation, therefore in this specification embodiment, corresponding offset ranges can be set, i.e.,
Deviation between multiple operational indicators in this range, can receive.It is normal that the setting of the offset ranges can be based on business
Count and obtain during execution.Here the restriction to the application should not formed.
Step S505：If being consistent between each operational indicator of database, but refer to each business from daily record
Mark is not consistent, then selected operational indicator is defined as into practical business index.
In other words, if operational indicator a1 is consistent with a2 (that is, the deviation between a1 and a2 is in setting range), but a1 and
A2 is not consistent with a3, then is preferentially defined by the operational indicator come from database, because business diary may be cleaned
Possibility, it is inaccurate so as to cause to come from the operational indicator (a3) of business diary.Therefore in the case, then reality is still used as using a1
Operational indicator.
Step S507：If be consistent between each operational indicator of identical services system, but with from other business
Each operational indicator of system is not consistent, then obtains history contemporaneous data, generation refers to operational indicator, and refers to business to approach this
The operational indicator of index is as practical business index.
In other words, if operational indicator a2 is consistent with a3, but the two is not consistent with a1, then obtains the business number of the history same period
According to (such as：The business datum of the previous day same time period), generation refer to operational indicator a4, and compare a4 and a1, a4 and a2, a3 it
Between extent of deviation, by being defined close to a4.It is assumed here that the deviation between a4 and a1 is minimum, then will operational indicator a1 conducts
Practical business index.Simultaneously, corresponding prompting message is can be sent out, to notify corresponding business personnel.
Step S509：Select one and select other operational indicators, as practical business index to be determined.
In this specification embodiment, it will usually prioritizing selection derives from the operational indicator in database, in other words, if
In operational indicator a2 and a3, a2 is generally selected.Simultaneously, corresponding prompting message is can be sent out, it is corresponding to notify
Business personnel.
Certainly, for above-mentioned index determination process, to ensure that data are correct, except counting obtained operational indicator
Outside comparison between numerical value, the comparison and hook that can also increase other dimensions are checked, and such as count the data of the full tables of trade_record
Measure (being assumed to be m), then, different data sectional (being assumed to be t1, t2 and t3) can be counted respectively by type of transaction, then it is necessary
Meet t1+t2+t3=m, otherwise show the missing of business datum, then can send reminder message, to ensure to increase data newly by type
It can be identified.
In addition, in actual applications, can also increase data source, such as：Pass through the application query service (app of service application
Service business datum) is obtained, and generates corresponding operational indicator (operational indicator can be designated as a5).Certainly, here not
It should be used as the restriction to the application.
The data processing method provided above for this specification embodiment, based on same thinking, this specification embodiment
A kind of data processing equipment is also provided, as shown in fig. 6, described device includes：
Acquisition module 601, the business datum of identical services is obtained from different data sources；
Processing module 602, for each business datum got, the business datum is handled, generation processing
As a result；
Determining module 603, practical business index is determined in each result of generation.
Further, the acquisition module 601, determines the operation system belonging to the business, determines the operation system
Corresponding Service Database, the business datum is obtained from the Service Database..
The acquisition module 601, determines the operation system belonging to the business, obtains the day that the operation system is generated
Will, the daily record is defined as the business datum.
On this basis, the processing module 602, for the business datum of each data source, patrolled according to the processing of setting
Collect and the business datum is handled, generate candidate Traffic index, the processing knot using the candidate Traffic index as generation
Fruit；
Wherein, the processing logic of setting comprises at least：Summation process, average value processing, difference processing.
The determining module 603, in each candidate Traffic index of generation, a selected candidate Traffic index is selected, as treating
Operational indicator is verified, the deviation between the operational indicator to be verified and other candidate Traffic indexs is detected, according to the deviation
Determine practical business index；
Wherein, the detection comprises at least：Compare and/or hook and check.
Further, the determining module 603, if the operational indicator to be verified and other any candidate Traffic indexs
Between deviation in setting range, then the operational indicator to be verified is defined as practical business index；
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs exceeds setting range,
One is selected in other candidate Traffic indexs and selectes operational indicator to be verified, replaces original operational indicator to be verified, and according to replacement after
The deviation of operational indicator to be verified determine practical business index.
The determining module 603, if the operational indicator to be verified with from same type data source other are alternative
Deviation between operational indicator in setting range, and between each alternative operational indicator in different types of data source
Deviation exceeds setting range, then the operational indicator to be verified is defined as into practical business index.
The determining module 603, if the operational indicator to be verified and each alternative business from identical services system
Deviation between index surpasses in setting range, and with the deviation between each alternative operational indicator of other operation systems
Go out setting range, then obtain history contemporaneous data, generation refer to operational indicator, and with and this with reference to the deviation between operational indicator
Minimum operational indicator is as practical business index.
Based on device as shown in Figure 6, this specification embodiment also provides a kind of data processing equipment, including：
Memory, data storage processing routine；
Communication interface, receive business datum
Processor, the data processor stored in memory is called, and performed：
By the communication interface, the business datum of acquisition identical services from different data sources；
For each business datum got, the business datum is handled, generates result；
Practical business index is determined in each result of generation.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.Especially for device,
For equipment and medium class embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, related part
Illustrate referring to the part of embodiment of the method, just no longer repeat one by one here.
It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims
It is interior.In some cases, the action recorded in detail in the claims or step or module can be according to different from embodiments
Order performs and still can realized desired result.In addition, the process described in the accompanying drawings not necessarily requires what is shown
Particular order or consecutive order could realize desired result.In some embodiments, multitasking and parallel processing
It is also possible or be probably favourable.
In the 1990s, the improvement for a technology can clearly distinguish be on hardware improvement (for example,
Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So
And as the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.
Designer nearly all obtains corresponding hardware circuit by the way that improved method flow is programmed into hardware circuit.Cause
This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, PLD
(Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate
Array, FPGA)) it is exactly such a integrated circuit, its logic function is determined by user to device programming.By designer
Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, without asking chip maker to design and make
Special IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " patrols
Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development,
And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language
(Hardware Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL
(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description
Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL
(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby
Hardware Description Language) etc., VHDL (Very-High-Speed are most generally used at present
Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also should
This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages,
Can is readily available the hardware circuit for realizing the logical method flow.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing
Device and storage can by the computer of the computer readable program code (such as software or firmware) of (micro-) computing device
Read medium, gate, switch, application specific integrated circuit (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller include but is not limited to following microcontroller
Device：ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, are deposited
Memory controller is also implemented as a part for the control logic of memory.It is also known in the art that except with
Pure computer readable program code mode realized beyond controller, completely can be by the way that method and step is carried out into programming in logic to make
Controller is obtained in the form of gate, switch, application specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc. to come in fact
Existing identical function.Therefore this controller is considered a kind of hardware component, and various for realizing to including in it
The device of function can also be considered as the structure in hardware component.Or even, can be by for realizing that the device of various functions regards
For that not only can be the software module of implementation method but also can be the structure in hardware component.
System, device, module or the unit that above-described embodiment illustrates, it can specifically be realized by computer chip or entity,
Or realized by the product with certain function.One kind typically realizes that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cell phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet PC, wearable device or these equipment
The combination of equipment.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, this is being implemented
The function of each unit can be realized in same or multiple softwares and/or hardware during application.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more
The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net
Network interface and internal memory.
Internal memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved
State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus
Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.Define, calculate according to herein
Machine computer-readable recording medium does not include temporary computer readable media (transitory media), the data letter numbering and carrier wave of such as modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability
Comprising so that process, method, commodity or equipment including a series of elements not only include those key elements, but also wrapping
Include the other element being not expressly set out, or also include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described
Other identical element also be present in the process of element, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program product.
Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Form.Deposited moreover, the application can use to can use in one or more computers for wherein including computer usable program code
The shape for the computer program product that storage media is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
The application can be described in the general context of computer executable instructions, such as program
Module.Usually, program module includes performing particular transaction or realizes routine, program, object, the group of particular abstract data type
Part, data structure etc..The application can also be put into practice in a distributed computing environment, in these DCEs, by
Affairs are performed and connected remote processing devices by communication network.In a distributed computing environment, program module can be with
In the local and remote computer-readable storage medium including storage device.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.It is real especially for system
For applying example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
Embodiments herein is the foregoing is only, is not limited to the application.For those skilled in the art
For, the application can have various modifications and variations.All any modifications made within spirit herein and principle, it is equal
Replace, improve etc., it should be included among the interest field of the application.
Claims (17)
1. a kind of data processing method, including：
The business datum of identical services is obtained from different data sources；
For each business datum got, the business datum is handled, generates result；
Practical business index is determined in each result of generation.
2. the method as described in claim 1, the business datum of identical services is obtained from different data sources, is specifically included：
Determine the operation system belonging to the business；
Determine the Service Database corresponding to the operation system；
The business datum is obtained from the Service Database.
3. the method as described in claim 1, the business datum of identical services is obtained from different data sources, is specifically included：
Determine the operation system belonging to the business；
The daily record that the operation system is generated is obtained, the daily record is defined as the business datum.
4. method as claimed in claim 2 or claim 3, handling the business datum, result is generated, is specifically included：
For the business datum of each data source, the business datum is handled according to the processing logic of setting, generation is waited
Select operational indicator；
Result using the candidate Traffic index as generation；
Wherein, the processing logic of setting comprises at least：Summation process, average value processing and/or difference processing.
5. method as claimed in claim 4, practical business index is determined in each result of generation, is specifically included：
In each candidate Traffic index of generation, a selected candidate Traffic index is selected, as operational indicator to be verified；
Detect the deviation between the operational indicator to be verified and other candidate Traffic indexs；
Practical business index is determined according to the deviation；
Wherein, the detection comprises at least：Compare and/or hook and check.
6. method as claimed in claim 5, practical business index is determined according to the deviation, specifically included：
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs is in setting range, by described in
Operational indicator to be verified is defined as practical business index；
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs exceeds setting range, at other
One is selected in candidate Traffic index and selectes operational indicator to be verified, replaces original operational indicator to be verified, and treat according to after replacement
The deviation of verification operational indicator determines practical business index.
7. method as claimed in claim 5, practical business index is determined according to the deviation, specifically included：
If the operational indicator to be verified and the deviation between other alternative operational indicators of same type data source exist
In setting range, and and the deviation between each alternative operational indicator in different types of data source exceed setting range, then
The operational indicator to be verified is defined as practical business index.
8. method as claimed in claim 5, practical business index is determined according to the deviation, specifically included：
If the operational indicator to be verified and the deviation between each alternative operational indicator of identical services system are being set
In the range of, and and the deviation between each alternative operational indicator of other operation systems exceed setting range, then acquisition is gone through
History contemporaneous data, generation refer to operational indicator, and using and this refer to the operational indicator of deviation minimum between operational indicator as
Practical business index.
9. a kind of data processing equipment, including：
Acquisition module, the business datum of identical services is obtained from different data sources；
Processing module, for each business datum got, the business datum is handled, generate result；
Determining module, practical business index is determined in each result of generation.
10. device as claimed in claim 9, the acquisition module, the operation system belonging to the business is determined, it is determined that described
Service Database corresponding to operation system, the business datum is obtained from the Service Database.
11. device as claimed in claim 9, the acquisition module, the operation system belonging to the business is determined, described in acquisition
The daily record that operation system is generated, the daily record is defined as the business datum.
12. the device as described in claim 10 or 11, the processing module, for the business datum of each data source, according to
The processing logic of setting is handled the business datum, generate candidate Traffic index, using the candidate Traffic index as
The result of generation；
Wherein, the processing logic of setting comprises at least：Summation process, average value processing, difference processing.
13. device as claimed in claim 12, the determining module, in each candidate Traffic index of generation, it is selected to select one
Candidate Traffic index, as operational indicator to be verified, detect between the operational indicator to be verified and other candidate Traffic indexs
Deviation, practical business index is determined according to the deviation；
Wherein, the detection comprises at least：Compare and/or hook and check.
14. device as claimed in claim 13, the determining module, if the operational indicator to be verified and other any candidates
The operational indicator to be verified is then defined as practical business index by the deviation between operational indicator in setting range；
If the deviation between the operational indicator to be verified and other any candidate Traffic indexs exceeds setting range, at other
One is selected in candidate Traffic index and selectes operational indicator to be verified, replaces original operational indicator to be verified, and treat according to after replacement
The deviation of verification operational indicator determines practical business index.
15. device as claimed in claim 13, the determining module, if the operational indicator to be verified is mutually similar with deriving from
Deviation between other alternative operational indicators of type data source in setting range, and with from each of different types of data source
Deviation between alternative operational indicator exceeds setting range, then the operational indicator to be verified is defined as into practical business index.
16. device as claimed in claim 13, the determining module, if the operational indicator to be verified is with deriving from the mutually same trade
Deviation between each alternative operational indicator of business system in setting range, and with each alternative industry from other operation systems
Deviation between business index exceed setting range, then obtains history contemporaneous data, generates and refers to operational indicator, and with the reference
The operational indicator of deviation minimum between operational indicator is as practical business index.
17. a kind of data processing equipment, including：
Memory, data storage processing routine；
Communication interface, receive business datum
Processor, the data processor stored in memory is called, and performed：
By the communication interface, the business datum of acquisition identical services from different data sources；
For each business datum got, the business datum is handled, generates result；
Practical business index is determined in each result of generation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710728625.3A CN107633015A (en) | 2017-08-23 | 2017-08-23 | A kind of data processing method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710728625.3A CN107633015A (en) | 2017-08-23 | 2017-08-23 | A kind of data processing method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107633015A true CN107633015A (en) | 2018-01-26 |
Family
ID=61100013
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710728625.3A Pending CN107633015A (en) | 2017-08-23 | 2017-08-23 | A kind of data processing method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107633015A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108196932A (en) * | 2018-01-31 | 2018-06-22 | 努比亚技术有限公司 | A kind of method for information display, terminal and computer readable storage medium |
| CN109376275A (en) * | 2018-10-29 | 2019-02-22 | 上海点融信息科技有限责任公司 | For monitoring the method, apparatus and medium of the operational indicator on block chain |
| CN110276514A (en) * | 2019-05-06 | 2019-09-24 | 阿里巴巴集团控股有限公司 | Appraisal procedure, device and the equipment of business correlative factor |
| CN110968483A (en) * | 2019-12-20 | 2020-04-07 | 支付宝实验室(新加坡)有限公司 | Service data acquisition method and device and electronic equipment |
| CN112487282A (en) * | 2020-11-04 | 2021-03-12 | 山东中创软件商用中间件股份有限公司 | Business processing condition monitoring method and device, electronic equipment and storage medium |
| CN113610616A (en) * | 2021-08-16 | 2021-11-05 | 傲林科技有限公司 | Financial checking relation analysis method and analysis system based on event network |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957953A (en) * | 2010-10-14 | 2011-01-26 | 谭长义 | System for auditing financial statement based on accrual amount |
| US20130085769A1 (en) * | 2010-03-31 | 2013-04-04 | Risk Management Solutions Llc | Characterizing healthcare provider, claim, beneficiary and healthcare merchant normal behavior using non-parametric statistical outlier detection scoring techniques |
| CN105243583A (en) * | 2015-09-28 | 2016-01-13 | 四川长虹电器股份有限公司 | Data processing method and data processing system |
| CN105321047A (en) * | 2015-11-10 | 2016-02-10 | 中国电力科学研究院 | Multi-dimensional verification method for schedule plan data |
| CN105447046A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Distributed system data consistency processing method, device and system |
| CN107015991A (en) * | 2016-01-28 | 2017-08-04 | 阿里巴巴集团控股有限公司 | Self checking method, device, system and the service apparatus of data consistency |
-
2017
- 2017-08-23 CN CN201710728625.3A patent/CN107633015A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130085769A1 (en) * | 2010-03-31 | 2013-04-04 | Risk Management Solutions Llc | Characterizing healthcare provider, claim, beneficiary and healthcare merchant normal behavior using non-parametric statistical outlier detection scoring techniques |
| CN101957953A (en) * | 2010-10-14 | 2011-01-26 | 谭长义 | System for auditing financial statement based on accrual amount |
| CN105447046A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Distributed system data consistency processing method, device and system |
| CN105243583A (en) * | 2015-09-28 | 2016-01-13 | 四川长虹电器股份有限公司 | Data processing method and data processing system |
| CN105321047A (en) * | 2015-11-10 | 2016-02-10 | 中国电力科学研究院 | Multi-dimensional verification method for schedule plan data |
| CN107015991A (en) * | 2016-01-28 | 2017-08-04 | 阿里巴巴集团控股有限公司 | Self checking method, device, system and the service apparatus of data consistency |
Non-Patent Citations (1)
| Title |
|---|
| 胡道新 等: "《税收理论与实践：安徽国税系统税收科研成果论文集》", 30 September 2009 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108196932A (en) * | 2018-01-31 | 2018-06-22 | 努比亚技术有限公司 | A kind of method for information display, terminal and computer readable storage medium |
| CN109376275A (en) * | 2018-10-29 | 2019-02-22 | 上海点融信息科技有限责任公司 | For monitoring the method, apparatus and medium of the operational indicator on block chain |
| CN110276514A (en) * | 2019-05-06 | 2019-09-24 | 阿里巴巴集团控股有限公司 | Appraisal procedure, device and the equipment of business correlative factor |
| CN110276514B (en) * | 2019-05-06 | 2023-04-07 | 创新先进技术有限公司 | Method, device and equipment for evaluating business related factors |
| CN110968483A (en) * | 2019-12-20 | 2020-04-07 | 支付宝实验室(新加坡)有限公司 | Service data acquisition method and device and electronic equipment |
| CN110968483B (en) * | 2019-12-20 | 2023-08-11 | 支付宝实验室(新加坡)有限公司 | Service data acquisition method and device and electronic equipment |
| CN112487282A (en) * | 2020-11-04 | 2021-03-12 | 山东中创软件商用中间件股份有限公司 | Business processing condition monitoring method and device, electronic equipment and storage medium |
| CN113610616A (en) * | 2021-08-16 | 2021-11-05 | 傲林科技有限公司 | Financial checking relation analysis method and analysis system based on event network |
| CN113610616B (en) * | 2021-08-16 | 2023-10-13 | 傲林科技有限公司 | Financial investigation relation analysis method and analysis system based on event network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107633015A (en) | A kind of data processing method, device and equipment | |
| US10664837B2 (en) | Method and system for real-time, load-driven multidimensional and hierarchical classification of monitored transaction executions for visualization and analysis tasks like statistical anomaly detection | |
| US8626702B2 (en) | Method and system for validation of data extraction | |
| CN107330776B (en) | Method and device for detecting bookkeeping and abnormal bookkeeping details | |
| CN104657255B (en) | Computer implemented method and system for monitoring information technological system | |
| US10025878B1 (en) | Data lineage analysis | |
| CN107424069A (en) | A kind of generation method of air control feature, risk monitoring and control method and apparatus | |
| CN107729376B (en) | Insurance data auditing method and device, computer equipment and storage medium | |
| CN107066519A (en) | A kind of task detection method and device | |
| CN107094166A (en) | A kind of service information sending method and device | |
| US10089334B2 (en) | Grouping of database objects | |
| CN110443618A (en) | The generation method and device of air control strategy | |
| CN106445938B (en) | Data detection method and device | |
| US20210150631A1 (en) | Machine learning approach to automatically disambiguate ambiguous electronic transaction labels | |
| CN109299096A (en) | A kind of processing method of pipelined data, device and equipment | |
| CN110175156A (en) | The generation method and device of report | |
| CN110515795A (en) | A kind of monitoring method of big data component, device, electronic equipment | |
| CN110262951A (en) | A kind of business second grade monitoring method and system, storage medium and client | |
| CN109359027A (en) | Monkey test method, device, electronic equipment and computer readable storage medium | |
| CN109166021A (en) | Bookkeeping methods, device and business finance integral system | |
| JPWO2007007410A1 (en) | Message analysis apparatus, control method, and control program | |
| CN106358220B (en) | The detection method of abnormal contact information, apparatus and system | |
| CN104123303B (en) | A kind of method and device that data are provided | |
| CN109918385A (en) | Tripartite's account checking method, electronic device and readable storage medium storing program for executing | |
| CN106708648A (en) | Text data storage checking method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201019 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20201019 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180126 |
|
| RJ01 | Rejection of invention patent application after publication |