CN108509266A - Data processing method, device, electronic equipment and computer readable storage medium - Google Patents

Data processing method, device, electronic equipment and computer readable storage medium Download PDF

Info

Publication number
CN108509266A
CN108509266A CN201810322204.5A CN201810322204A CN108509266A CN 108509266 A CN108509266 A CN 108509266A CN 201810322204 A CN201810322204 A CN 201810322204A CN 108509266 A CN108509266 A CN 108509266A
Authority
CN
China
Prior art keywords
transaction data
transaction
processing
processing device
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810322204.5A
Other languages
Chinese (zh)
Inventor
杨考
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaodu Information Technology Co Ltd
Original Assignee
Beijing Xiaodu Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaodu Information Technology Co Ltd filed Critical Beijing Xiaodu Information Technology Co Ltd
Priority to CN201810322204.5A priority Critical patent/CN108509266A/en
Publication of CN108509266A publication Critical patent/CN108509266A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • General Engineering & Computer Science (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

The embodiment of the present disclosure discloses a kind of data processing method, device, electronic equipment and computer readable storage medium, the method includes:The transaction data generated in process of exchange is obtained, and corresponding transaction data is detected according to prefixed time interval, wherein the transaction data includes one or more of following:Transaction data generates information, transaction data processing information, transaction data process performance information;It is abnormal in response to the transaction data, starting guide processing operation;Processing is optimized for the transaction data or transaction process flow.The technical solution can quickly be handled the transaction data such as account, realized fast reaction, and then provide strong back-office support for developing for follow-up Internet service, promoted user experience.

Description

Data processing method, device, electronic equipment and computer readable storage medium
Technical field
This disclosure relates to technical field of information processing, and in particular to a kind of data processing method, device, electronic equipment and meter Calculation machine readable storage medium storing program for executing.
Background technology
With the rapid development of Internet technology, Internet user's quantity is increased sharply, and corresponding accounting data also shows finger The growth of number type.The rule of follow-up Internet service development are not only determined for the quick processing and fast reaction of accounting data Mould, while also contributing to the experience of user, especially business are complicated, be related to the numerous O2O of link (Online To Offline, To under line on line) business, an order is related to the Fund Supervision of multiple roles, therefore an order has corresponded to N number of bill, therefore Order volume often doubles, and accounting processing ability is possible to that performance requirement cannot be met.
Invention content
A kind of data processing method of embodiment of the present disclosure offer, device, electronic equipment and computer readable storage medium.
In a first aspect, providing a kind of data processing method in the embodiment of the present disclosure.
Specifically, the data processing method, including:
Obtain the transaction data that generates in process of exchange, and according to prefixed time interval detect corresponding number of deals it is believed that Breath, wherein the transaction data includes one or more of following:Transaction data generates information, transaction data processing Information, transaction data process performance information;
It is abnormal in response to the transaction data, starting guide processing operation;
Processing is optimized for the transaction data or transaction process flow.
With reference to first aspect, the disclosure is described according to prefixed time interval in the first realization method of first aspect Detect corresponding transaction data, including one of the following or multiple steps:
Obtain transaction data according to prefixed time interval and generate information, wherein the transaction data generate information include with It is one or more in lower:Transaction data generated time, transaction data generation quantity and transaction data formation speed;
Obtain transaction data according to prefixed time interval and handle information, wherein transaction data processing information include with It is one or more in lower:Transaction data processing starting, transaction data processing spend the time, transaction data processing quantity and Transaction data processing speed;
Transaction data process performance information is obtained according to prefixed time interval, wherein the transaction data process performance letter Breath include it is following in it is one or more:At transaction processing device quantity, transaction processing device treating capacity and transaction processing device Manage speed.
With reference to first aspect with the first realization method of first aspect, the disclosure is in second of realization side of first aspect In formula, the transaction data is abnormal including one or more of following:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio Less than the 7th threshold value.
With reference to first aspect, second of realization method of the first realization method of first aspect and first aspect, this public affairs It is opened in the third realization method of first aspect, it is described processing is optimized for transaction data or transaction process flow to include One or more of below:
Classified for the transaction data according to the type of the transaction data, according to classification for the number of deals According to being handled;
According to the attribute information of the transaction data carry out stage decomposition, stage by stage for the transaction data at Reason;
Increase the treating capacity of single transaction processing device;
Increase the quantity of transaction processing device;
Reduce the treating capacity of single transaction processing device;
Batch processing is carried out for the transaction data and merges update;
Debug transaction processing device performance;
Trading account where increase or split transactions data.
With reference to first aspect, the first realization method of first aspect, first aspect second of realization method and first The third realization method of aspect, the disclosure generate in the 4th kind of realization method of first aspect in acquisition process of exchange Further include before transaction data:
Transaction data is predicted according to prior information;
The transaction data obtained according to prediction is allocated transaction processing device.
With reference to first aspect, the first realization method, second of realization method of first aspect of first aspect, first party The third realization method in face and the 4th of first aspect the kind of realization method, five kind realization method of the disclosure in first aspect In, further include:
Export transaction data processing result information or process state information.
Second aspect provides a kind of data processing equipment in the embodiment of the present disclosure.
Specifically, the data processing equipment, including:
Detection module is configured as obtaining the transaction data generated in process of exchange, and is detected according to prefixed time interval Corresponding transaction data, wherein the transaction data includes one or more of following:Transaction data generates letter Breath, transaction data processing information, transaction data process performance information;
Starting module is configured to respond to the transaction data and is abnormal, starting guide processing operation;
Optimization module is configured as optimizing processing for the transaction data or transaction process flow.
In conjunction with second aspect, for the disclosure in the first realization method of second aspect, the detection module includes following One or more of submodule:
First acquisition submodule is configured as obtaining transaction data generation information according to prefixed time interval, wherein described Transaction data generate information include it is following in it is one or more:Transaction data generated time, transaction data generation quantity and friendship Easy data formation speed;
Second acquisition submodule is configured as obtaining transaction data processing information according to prefixed time interval, wherein described Transaction data processing information include it is following in it is one or more:Transaction data processing starting, transaction data processing are spent Time, transaction data processing quantity and transaction data processing speed;
Third acquisition submodule is configured as obtaining transaction data process performance information according to prefixed time interval, wherein The transaction data process performance information include it is following in it is one or more:Transaction processing device quantity, transaction processing device Treating capacity and transaction processing device processing speed.
In conjunction with the first of second aspect and second aspect realization method, the disclosure is in second of realization side of second aspect In formula, the transaction data is abnormal including one or more of following:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio Less than the 7th threshold value.
In conjunction with the first realization method of second aspect, second aspect and second of realization method of second aspect, this public affairs It is opened in the third realization method of second aspect, the optimization module includes that following submodule is in the block one or several:
First optimization submodule, is configured as dividing the transaction data according to the type of the transaction data Class is handled the transaction data according to classification;
Second optimization submodule, is configured as carrying out stage decomposition according to the attribute information of the transaction data, stage by stage The transaction data is handled;
Third optimizes submodule, is configured as increasing the treating capacity of single transaction processing device;
4th optimization submodule is configured as increasing the quantity of transaction processing device;
5th optimization submodule, is configured as reducing the treating capacity of single transaction processing device;
6th optimization submodule is configured as carrying out batch processing for the transaction data and merges update;
7th optimization submodule, is configured as debugging transaction processing device performance;
8th optimization submodule, the trading account being configured as where increase or split transactions data.
In conjunction with the first realization method of second aspect, second aspect, second of realization method and second of second aspect The third realization method of aspect, the disclosure further include in the 4th kind of realization method of second aspect:
Prediction module is configured as predicting transaction data according to prior information;
Distribution module is configured as being allocated transaction processing device according to the transaction data that prediction obtains.
In conjunction with the first realization method, second of realization method of second aspect, second party of second aspect, second aspect The third realization method in face and the 4th of second aspect the kind of realization method, five kind realization method of the disclosure in second aspect In, further include:
Output module is configured as output transaction data processing result information or process state information.
The third aspect, the embodiment of the present disclosure provide a kind of electronic equipment, including memory and processor, the memory The computer instruction of data processing method in above-mentioned first aspect is executed for storing one or more support data processing equipment, The processor is configurable for executing the computer instruction stored in the memory.The data processing equipment can be with Including communication interface, for data processing equipment and other equipment or communication.
Fourth aspect, the embodiment of the present disclosure provide a kind of computer readable storage medium, for storing data processing dress Computer instruction used is set, it includes be involved by data processing equipment for executing data processing method in above-mentioned first aspect And computer instruction.
The technical solution that the embodiment of the present disclosure provides can include the following benefits:
Above-mentioned technical proposal generates information, transaction data processing letter by detecting transaction data and relevant transaction data The transaction datas such as breath, transaction data process performance information judge the processing for transaction data with the presence or absence of overstocked, congestion Etc. abnormal phenomenon, and judge be abnormal when, start for transaction data or transaction process flow optimization processing.The skill Art scheme can quickly be handled the transaction data such as account, realize fast reaction, and then be the development of follow-up Internet service Grow and strong back-office support is provided, promotes user experience.
It should be understood that above general description and following detailed description is only exemplary and explanatory, not The disclosure can be limited.
Description of the drawings
In conjunction with attached drawing, by the detailed description of following non-limiting embodiment, the other feature of the disclosure, purpose and excellent Point will be apparent.In the accompanying drawings:
Fig. 1 shows the flow chart of the data processing method according to one embodiment of the disclosure;
Fig. 2 shows the flow charts according to the data processing method of another embodiment of the disclosure;
Fig. 3 shows the structure diagram of the data processing equipment according to one embodiment of the disclosure;
Fig. 4 shows the structure diagram of the detection module 301 of the data processing equipment of embodiment according to Fig.3,;
Fig. 5 shows the structure diagram of the optimization module 303 of the data processing equipment of embodiment according to Fig.3,;
Fig. 6 shows the structure diagram of the data processing equipment according to another embodiment of the disclosure;
Fig. 7 shows the structure diagram of the electronic equipment according to one embodiment of the disclosure;
Fig. 8 is adapted for the structure of the computer system for realizing the data processing method according to one embodiment of the disclosure Schematic diagram.
Specific implementation mode
Hereinafter, the illustrative embodiments of the disclosure will be described in detail with reference to the attached drawings, so that those skilled in the art can Easily realize them.In addition, for the sake of clarity, the portion unrelated with description illustrative embodiments is omitted in the accompanying drawings Point.
In the disclosure, it should be appreciated that the term of " comprising " or " having " etc. is intended to refer to disclosed in this specification Feature, number, step, behavior, the presence of component, part or combinations thereof, and be not intended to exclude other one or more features, Number, step, behavior, component, part or combinations thereof there is a possibility that or be added.
It also should be noted that in the absence of conflict, the feature in embodiment and embodiment in the disclosure It can be combined with each other.The disclosure is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
The technical solution that the embodiment of the present disclosure provides generates letter by detecting transaction data and relevant transaction data The transaction datas such as breath, transaction data processing information, transaction data process performance information, judge the processing for transaction data With the presence or absence of abnormal phenomenon such as overstocked, congestions, and when judging to be abnormal, start for transaction data or trading processing stream The optimization processing of journey.The technical solution can quickly be handled the transaction data such as account, realize fast reaction, and then be follow-up Developing for Internet service provides strong back-office support, promotes user experience.
Fig. 1 shows the flow chart of the data processing method according to one embodiment of the disclosure.As shown in Figure 1, the data Processing method includes the following steps S101-S103:
In step S101, the transaction data generated in process of exchange is obtained, and detect accordingly according to prefixed time interval Transaction data, wherein the transaction data includes one or more of following:Transaction data generation information, Transaction data handles information, transaction data process performance information;
In step s 102, it is abnormal in response to the transaction data, starting guide processing operation;
In step s 103, processing is optimized for the transaction data or transaction process flow.
Mentioned above, with the rapid development of Internet technology, Internet user's quantity is increased sharply, corresponding accounting data Show the growth of exponential type.And it is weaker for the accounting data processing capacity of big data quantity in the prior art, ensure at account Manage the time be typically to sacrifice handling capacity as cost, equally, if think guarantee handling capacity, the accounting processing time will become compared with It is long, it can not only hinder developing for follow-up Internet service significantly in this way, but also user experience can be dragged down.
In view of drawbacks described above, in this embodiment, propose that a kind of data processing method, this method obtain transaction first The transaction data generated in the process, and detect corresponding transaction data in real time according to prefixed time interval, wherein the friendship Easy data information includes one or more of following:Transaction data generates information, transaction data handles information, at transaction data Manage performance information;Then whether detection transaction data is abnormal, if exception has occurred, starts for the number of deals According to or transaction process flow optimization processing.
The technical solution can detect the data handled in real time, and when noting abnormalities, at the first time for Related data optimizes processing, this makes it possible to ensure to realize quickly processing and fast reaction for transaction data such as accounts, And then strong back-office support is provided for developing for follow-up Internet service, promote user experience.
In an optional realization method of the present embodiment, in the step S101, phase is detected according to prefixed time interval The step of transaction data answered, including one of the following or multiple steps:
Obtain transaction data according to prefixed time interval and generate information, wherein the transaction data generate information include with It is one or more in lower:Transaction data generated time, transaction data generation quantity and transaction data formation speed;
Obtain transaction data according to prefixed time interval and handle information, wherein transaction data processing information include with It is one or more in lower:Transaction data processing starting, transaction data processing spend time, transaction data to handle quantity And/or transaction data processing speed;
Transaction data process performance information is obtained according to prefixed time interval, wherein the transaction data process performance letter Breath include it is following in it is one or more:At transaction processing device quantity, transaction processing device treating capacity and transaction processing device Manage speed.
In this embodiment, it obtains transaction data in real time according to prefixed time interval and generates information, transaction data processing It is one or more in information, transaction data process performance information, judge to use for abnormal.Wherein, the transaction data life At information include it is following in it is one or more:Transaction data generated time, transaction data generation quantity and transaction data generate Speed, the transaction data generated time refer to that time when some transaction data generates, the transaction data generate number Amount refers to that generated transaction data quantity in the prefixed time interval, the transaction data formation speed refer to unit The transaction data quantity generated in time;Transaction data processing information include it is following in it is one or more:Transaction data Processing starting, transaction data processing spend time, transaction data processing quantity and transaction data processing speed, the transaction Data processing initial time refers to time when transaction processing device start to process transaction data, the transaction data processing flower Time-consuming to refer to that transaction processing device handles the time that a certain transaction data is spent in total, the transaction data processing quantity refers to Be transaction processing device is handled in prefixed time interval transaction data quantity, the transaction data processing speed refers to list Transaction data quantity in the time of position handled by transaction processing device;During the transaction data process performance information includes following It is one or more:Transaction processing device quantity, transaction processing device treating capacity and transaction processing device processing speed, the transaction Processing equipment quantity include it is in running order in transaction processing device quantity, and equipment that data processing can be traded Total quantity, the transaction processing device treating capacity refer to the transaction data quantity that a certain transaction processing device can be handled, institute State the transaction data quantity that transaction processing device processing speed refers to a certain transaction processing device processing in the unit interval.
In an optional realization method of the present embodiment, in the step S102, transaction data is abnormal packet It includes one or more of following:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio Less than the 7th threshold value.
It is described that transaction data or transaction process flow are optimized in an optional realization method of the present embodiment Processing includes one or more of following:
Classified for the transaction data according to the type of the transaction data, according to classification for the number of deals According to being handled;
According to the attribute information of the transaction data carry out stage decomposition, stage by stage for the transaction data at Reason;
Increase the treating capacity of single transaction processing device;
Increase the quantity of transaction processing device;
Reduce the treating capacity of single transaction processing device;
Batch processing is carried out for the transaction data and merges update;
Debug transaction processing device performance;
Trading account where increase or split transactions data.
In the above-described embodiment, when overstocked, congestion occurs in transaction data, excess load occurs in transaction processing device, transaction Situations such as data bulk is very few, transaction processing device leaves unused thinks exception occur for the processing of transaction data, needs Processing is optimized for transaction data and transaction data process flow.
For example, according to the principle of production and consumption velocity balance, the formation speed of transaction data and transaction data are handled 1 hereinafter, such as 0.8~0.9, i.e. the formation speed of transaction data is less than or equal at transaction data for Ratio control between speed Speed is managed, can preferably utilize all system resource in this way.Therefore, it is handed over if detecting that the formation speed of transaction data is more than The processing speed of easy data, alternatively, the transaction data formation speed in preset time period is more than first threshold, this illustrates number of deals According to processing occurred overstocking or be possible to will appear overstocked, then need for transaction data and transaction data processing stream Journey optimizes processing, for example, being classified for the transaction data according to the type of the transaction data, according still further to classification The transaction data is handled, wherein the type of the transaction data includes one or more of following:On line Transaction data, off-line transaction data, merchant transaction data, customer transaction data and other different types of transaction data, or Person carries out stage decomposition according to the attribute information of the transaction data, the transaction data is handled stage by stage, to carry High transaction data treatment effeciency and speed, wherein the attribute information of the transaction data includes one or more of following:It connects Data are received, data is handled, summarizes data, output data and storage data;For another example, increase the processing of single transaction processing device Amount, alternatively, increasing the quantity of transaction processing device, to improve the processing speed of transaction data.
For example, if detection finds that the treating capacity of single transaction processing device is higher than second threshold, this illustrates the trading processing The treating capacity of equipment is close to load or has exceeded load, needs to carry out reduced pressure treatment for the transaction processing device, reduce The treating capacity of the transaction processing device, to ensure its safe work state.
For example, if detection finds that the instantaneous processing speed of single transaction processing device is less than third threshold value, this illustrates the friendship Disposable equipment may handle the transaction data of big data quantity, in order to ensure the usage experience of user, enhance transaction data The stability of processing system, the transaction data that a certain predetermined threshold value can be more than to data volume take batch processing, merging newer Strategy returns to processing state, but handling result is handling this batch in real time that is, for the transaction data batch processing of big data quantity It returns and updates together after data, big data quantity transaction data can be effectively relieved in this way to caused by transaction processing device Pressure is managed, although user does not promptly appreciate that handling result, since processing shape can be returned in real time while batch processing State, therefore injury will not be generated for the experience of user.
If for example, detect single transaction processing device in preset time period average treatment speed be less than the 4th threshold value, This illustrates that the transaction processing device may have occurred failure, needs to carry out performance adjustment further to the transaction processing device, When confirming that failure has occurred in the transaction processing device by performance adjustment, then the treating capacity of the transaction processing device is reduced, directly To the work for stopping the transaction processing device, when confirming that the transaction processing device restores one's working ability by performance adjustment, then Increase the treating capacity of the transaction processing device.
For example, ratio of the transaction processing device in detection discovery is in running order in whole transaction processing devices When higher than five threshold values, it is believed that the quantity of transaction processing device is possible to that deficiency can occur within following a period of time at this time, because This, can take the circumstances into consideration the quantity for increasing transaction processing device.
For example, when detection finds that single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in When transaction processing device ratio is less than seven threshold values, it is believed that there is a degree of redundancy in transaction processing device at this time, in order to It economizes on resources, the quantity for reducing transaction processing device can be taken the circumstances into consideration.
If can not solve the abnormal problem of transaction data by above-mentioned various optimization means, can attempt to pass through Increase or split transactions account, and distributes other transaction processing devices at the trading account that increases or split The mode of reason solves.
In an optional realization method of the present embodiment, as shown in Fig. 2, the method generates in obtaining process of exchange Transaction data before further include step S201-S202:
In step s 201, transaction data is predicted according to prior information;
In step S202, the transaction data obtained according to prediction is allocated transaction processing device.
It in this embodiment, can be according to prior information in order to improve reasonability when transaction processing device original allocation Predict transaction data, the transaction data obtained further according to prediction carries out the quantity and task amount of transaction processing device Distribution, wherein the prior information can be obtained according to the historical trading processing data obtained in historical time section.
In addition, in dispensing transaction processing equipment, it can be according to the principle that single quota is distributed to the number of transaction processing device It is allocated, i.e., first makes the data processing amount of first transaction processing device to receive an assignment at full capacity or connects according to treating capacity Closely at full capacity, then reach a pre-set safe load line (such as at full capacity 80%), reallocate second and connect By the transaction processing device of task, and so on, which can maximally utilise transaction processing device resource.
In an optional realization method of the present embodiment, the method further includes step:
Export transaction data processing result information or process state information.
In this embodiment, after being completed to transaction data processing, number of deals can be exported according to the mode that pre-sets According to processing result information either status information with the result for informing customer transaction data processing or processing shape residing at present State improves user experience.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 3 shows that the structure diagram of the data processing equipment according to one embodiment of the disclosure, the device can be by soft Part, hardware or both are implemented in combination with as some or all of of electronic equipment.As shown in figure 3, the data processing dress Set including:
Detection module 301 is configured as obtaining the transaction data generated in process of exchange, and is examined according to prefixed time interval Survey corresponding transaction data, wherein the transaction data includes one or more of following:Transaction data generates Information, transaction data processing information, transaction data process performance information;
Starting module 302 is configured to respond to the transaction data and is abnormal, starting guide processing operation;
Optimization module 303 is configured as optimizing processing for the transaction data or transaction process flow.
Mentioned above, with the rapid development of Internet technology, Internet user's quantity is increased sharply, corresponding accounting data Show the growth of exponential type.And it is weaker for the accounting data processing capacity of big data quantity in the prior art, ensure at account Manage the time be typically to sacrifice handling capacity as cost, equally, if think guarantee handling capacity, the accounting processing time will become compared with It is long, it can not only hinder developing for follow-up Internet service significantly in this way, but also user experience can be dragged down.
In view of drawbacks described above, in this embodiment, a kind of data processing equipment is proposed, which passes through detection first Module 301 obtains the transaction data generated in process of exchange, and detects corresponding transaction data in real time according to prefixed time interval Information, wherein the transaction data includes one or more of following:At transaction data generation information, transaction data Manage information, transaction data process performance information;Then starting module 302 opens after detecting that transaction data is abnormal Optimization processing of the dynamic optimization module 303 for the transaction data or transaction process flow.
The technical solution can detect the data handled in real time, and when noting abnormalities, at the first time for Related data optimizes processing, this makes it possible to ensure to realize quickly processing and fast reaction for transaction data such as accounts, And then strong back-office support is provided for developing for follow-up Internet service, promote user experience.
In an optional realization method of the present embodiment, as shown in figure 4, the detection module 301 includes following submodule One or more in the block:
First acquisition submodule 401 is configured as obtaining transaction data generation information according to prefixed time interval, wherein The transaction data generate information include it is following in it is one or more:Transaction data generated time, transaction data generation quantity With transaction data formation speed;
Second acquisition submodule 402 is configured as obtaining transaction data processing information according to prefixed time interval, wherein Transaction data processing information include it is following in it is one or more:Transaction data processing starting, transaction data processing Spend time, transaction data processing quantity and transaction data processing speed;
Third acquisition submodule 403 is configured as obtaining transaction data process performance information according to prefixed time interval, In, the transaction data process performance information include it is following in it is one or more:Transaction processing device quantity, trading processing are set Standby treating capacity and transaction processing device processing speed.
In this embodiment, above-mentioned submodule obtains transaction data according to prefixed time interval and generates information, hands in real time It is one or more in easy data processing of information, transaction data process performance information, judge to use for abnormal.Wherein, described Transaction data generate information include it is following in it is one or more:Transaction data generated time, transaction data generation quantity and friendship Easy data formation speed, the transaction data generated time refer to time when some transaction data generates, the transaction Data generation quantity refers to generated transaction data quantity in the prefixed time interval, the transaction data formation speed Refer to the transaction data quantity generated in the unit interval;Transaction data processing information include it is following in one kind or more Kind:Transaction data processing starting, transaction data processing spend time, transaction data processing quantity and transaction data processing speed Degree, the transaction data processing starting refer to time when transaction processing device start to process transaction data, the friendship Easy data processing spends the time to refer to that transaction processing device handles the time that a certain transaction data is spent in total, the number of deals The transaction data quantity that transaction processing device is handled in prefixed time interval, the transaction data processing are referred to according to processing quantity Speed refers to the transaction data quantity handled by transaction processing device in the unit interval;The transaction data process performance information Including one or more in following:Transaction processing device quantity, transaction processing device treating capacity and transaction processing device processing Speed, the transaction processing device quantity include it is in running order in transaction processing device quantity, and can be traded The equipment total quantity of data processing, the transaction processing device treating capacity refer to the friendship that a certain transaction processing device can be handled Easy data bulk, the transaction processing device processing speed refer to the transaction of a certain transaction processing device processing in the unit interval Data bulk.
In an optional realization method of the present embodiment, the transaction data is abnormal including one in following Kind is several:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio Less than the 7th threshold value.
In an optional realization method of the present embodiment, as shown in figure 5, the optimization module 303 includes following submodule It is in the block one or several:
First optimization submodule 501 is configured as carrying out the transaction data according to the type of the transaction data Classification, is handled the transaction data according to classification;
Second optimization submodule 502, is configured as carrying out stage decomposition, sublevel according to the attribute information of the transaction data Section handles the transaction data;
Third optimizes submodule 503, is configured as increasing the treating capacity of single transaction processing device;
4th optimization submodule 504 is configured as increasing the quantity of transaction processing device;
5th optimization submodule 505, is configured as reducing the treating capacity of single transaction processing device;
6th optimization submodule 506 is configured as carrying out batch processing for the transaction data and merges update;
7th optimization submodule 507, is configured as debugging transaction processing device performance;
8th optimization submodule 508, the trading account being configured as where increase or split transactions data.
In the above-described embodiment, when overstocked, congestion occurs in transaction data, excess load occurs in transaction processing device, transaction Situations such as data bulk is very few, transaction processing device leaves unused thinks exception occur for the processing of transaction data, needs Processing is optimized for transaction data and transaction data process flow.
For example, according to the principle of production and consumption velocity balance, the formation speed of transaction data and transaction data are handled 1 hereinafter, such as 0.8~0.9, i.e. the formation speed of transaction data is less than or equal at transaction data for Ratio control between speed Speed is managed, can preferably utilize all system resource in this way.Therefore, it is handed over if detecting that the formation speed of transaction data is more than The processing speed of easy data, alternatively, the transaction data formation speed in preset time period is more than first threshold, this illustrates number of deals According to processing occurred overstocking or be possible to will appear overstocked, then need for transaction data and transaction data processing stream Journey optimizes processing, for example, being classified for the transaction data according to the type of the transaction data, according still further to classification The transaction data is handled, wherein the type of the transaction data includes one or more of following:On line Transaction data, off-line transaction data, merchant transaction data, customer transaction data and other different types of transaction data, or Person carries out stage decomposition according to the attribute information of the transaction data, the transaction data is handled stage by stage, to carry High transaction data treatment effeciency and speed, wherein the attribute information of the transaction data includes one or more of following:It connects Data are received, data is handled, summarizes data, output data and storage data;For another example, increase the processing of single transaction processing device Amount, alternatively, increasing the quantity of transaction processing device, to improve the processing speed of transaction data.
For example, if detection finds that the treating capacity of single transaction processing device is higher than second threshold, this illustrates the trading processing The treating capacity of equipment is close to load or has exceeded load, needs to carry out reduced pressure treatment for the transaction processing device, reduce The treating capacity of the transaction processing device, to ensure its safe work state.
For example, if detection finds that the instantaneous processing speed of single transaction processing device is less than third threshold value, this illustrates the friendship Disposable equipment may handle the transaction data of big data quantity, in order to ensure the usage experience of user, enhance transaction data The stability of processing system, the transaction data that a certain predetermined threshold value can be more than to data volume take batch processing, merging newer Strategy returns to processing state, but handling result is handling this batch in real time that is, for the transaction data batch processing of big data quantity It returns and updates together after data, big data quantity transaction data can be effectively relieved in this way to caused by transaction processing device Pressure is managed, although user does not promptly appreciate that handling result, since processing shape can be returned in real time while batch processing State, therefore injury will not be generated for the experience of user.
If for example, detect single transaction processing device in preset time period average treatment speed be less than the 4th threshold value, This illustrates that the transaction processing device may have occurred failure, needs to carry out performance adjustment further to the transaction processing device, When confirming that failure has occurred in the transaction processing device by performance adjustment, then the treating capacity of the transaction processing device is reduced, directly To the work for stopping the transaction processing device, when confirming that the transaction processing device restores one's working ability by performance adjustment, then Increase the treating capacity of the transaction processing device.
For example, ratio of the transaction processing device in detection discovery is in running order in whole transaction processing devices When higher than five threshold values, it is believed that the quantity of transaction processing device is possible to that deficiency can occur within following a period of time at this time, because This, can take the circumstances into consideration the quantity for increasing transaction processing device.
For example, when detection finds that single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in When transaction processing device ratio is less than seven threshold values, it is believed that there is a degree of redundancy in transaction processing device at this time, in order to It economizes on resources, the quantity for reducing transaction processing device can be taken the circumstances into consideration.
If can not solve the abnormal problem of transaction data by above-mentioned various optimization means, can attempt to pass through Increase or split transactions account, and distributes other transaction processing devices at the trading account that increases or split The mode of reason solves.
In an optional realization method of the present embodiment, as shown in fig. 6, described device further includes:
Prediction module 601 is configured as predicting transaction data according to prior information;
Distribution module 602 is configured as being allocated transaction processing device according to the transaction data that prediction obtains.
In this embodiment, in order to improve reasonability when transaction processing device original allocation, prediction module 601 can root Transaction data is predicted according to prior information, and distribution module 602 is further according to the obtained transaction data of prediction to trading processing The quantity and task amount of equipment are allocated, wherein the prior information can be according to the historical trading obtained in historical time section Processing data obtain.
In addition, distribution module 602 is in dispensing transaction processing equipment, can according to the principle that single quota is distributed to transaction at The data processing amount of reason equipment is allocated, i.e., first so that the data processing amount of first transaction processing device to receive an assignment is full Load either close to again or reaching a pre-set safe load line (such as at full capacity 80%) at full capacity, then divides The transaction processing device to receive an assignment with second, and so on, which can maximally utilise trading processing Device resource.
In an optional realization method of the present embodiment, described device further includes:
Output module is configured as output transaction data processing result information or process state information.
In this embodiment, after being completed to transaction data processing, output module can be defeated according to pre-setting mode Go out transaction data processing result information either status information to inform the result of customer transaction data processing or residing at present Processing state improves user experience.
The disclosure also discloses a kind of electronic equipment, and Fig. 7 shows the knot of the electronic equipment according to one embodiment of the disclosure Structure block diagram, as shown in fig. 7, the electronic equipment 700 includes memory 701 and processor 702;Wherein,
The memory 701 is for storing one or more computer instruction, wherein one or more computer refers to It enables and being executed by the processor 702 to realize any of the above-described method and step.
Fig. 8 is suitable for being used for realizing the structural representation of the computer system of the data processing method according to disclosure embodiment Figure.
As shown in figure 8, computer system 800 includes central processing unit (CPU) 801, it can be read-only according to being stored in Program in memory (ROM) 802 or be loaded into the program in random access storage device (RAM) 803 from storage section 808 and Execute the various processing in the above embodiment.In RAM803, also it is stored with system 800 and operates required various program sum numbers According to.CPU801, ROM802 and RAM803 are connected with each other by bus 804.Input/output (I/O) interface 805 is also connected to always Line 804.
It is connected to I/O interfaces 805 with lower component:Importation 806 including keyboard, mouse etc.;It is penetrated including such as cathode The output par, c 807 of spool (CRT), liquid crystal display (LCD) etc. and loud speaker etc.;Storage section 808 including hard disk etc.; And the communications portion 809 of the network interface card including LAN card, modem etc..Communications portion 809 via such as because The network of spy's net executes communication process.Driver 810 is also according to needing to be connected to I/O interfaces 805.Detachable media 811, such as Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on driver 810, as needed in order to be read from thereon Computer program be mounted into storage section 808 as needed.
Particularly, according to embodiment of the present disclosure, it may be implemented as computer above with reference to the method for Fig. 1-2 descriptions Software program.For example, embodiment of the present disclosure includes a kind of computer program product comprising be tangibly embodied in and its can The computer program on medium is read, the computer program includes the program code for executing the data processing method. In such embodiment, which can be downloaded and installed by communications portion 809 from network, and/or from Detachable media 811 is mounted.
Flow chart in attached drawing and block diagram, it is illustrated that according to the system, method and computer of the various embodiments of the disclosure The architecture, function and operation in the cards of program product.In this regard, each box in course diagram or block diagram can be with A part for a module, section or code is represented, a part for the module, section or code includes one or more Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical On can be basically executed in parallel, they can also be executed in the opposite order sometimes, this is depended on the functions involved.Also it wants It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer The combination of order is realized.
Being described in unit or module involved in disclosure embodiment can be realized by way of software, also may be used It is realized in a manner of by hardware.Described unit or module can also be arranged in the processor, these units or module Title do not constitute the restriction to the unit or module itself under certain conditions.
As on the other hand, the disclosure additionally provides a kind of computer readable storage medium, the computer-readable storage medium Matter can be computer readable storage medium included in device described in the above embodiment;Can also be individualism, Without the computer readable storage medium in supplying equipment.There are one computer-readable recording medium storages or more than one journey Sequence, described program is used for executing by one or more than one processor is described in disclosed method.
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.People in the art Member should be appreciated that invention scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from the inventive concept, it is carried out by above-mentioned technical characteristic or its equivalent feature Other technical solutions of arbitrary combination and formation.Such as features described above has similar work(with (but not limited to) disclosed in the disclosure Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (10)

1. a kind of data processing method, which is characterized in that including:
The transaction data generated in process of exchange is obtained, and corresponding transaction data is detected according to prefixed time interval, In, the transaction data includes one or more of following:Transaction data generates information, transaction data handles information, Transaction data process performance information;
It is abnormal in response to the transaction data, starting guide processing operation;
Processing is optimized for the transaction data or transaction process flow.
2. according to the method described in claim 1, it is characterized in that, described detect corresponding number of deals according to prefixed time interval It is believed that breath, including one of the following or multiple steps:
Transaction data is obtained according to prefixed time interval and generates information, wherein during the transaction data generation information includes following It is one or more:Transaction data generated time, transaction data generation quantity and transaction data formation speed;
Transaction data is obtained according to prefixed time interval and handles information, wherein during the transaction data processing information includes following It is one or more:Transaction data processing starting, transaction data processing spend time, transaction data processing quantity and transaction Data processing speed;
Transaction data process performance information is obtained according to prefixed time interval, wherein the transaction data process performance packet Include it is following in it is one or more:Transaction processing device quantity, transaction processing device treating capacity and transaction processing device processing speed Degree.
3. according to the method described in claim 2, it is characterized in that, the transaction data is abnormal including in following It is one or more of:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio be less than 7th threshold value.
4. according to the method described in claim 1, it is characterized in that, described excellent for transaction data or transaction process flow progress It includes one or more of following to change processing:
Classified for the transaction data according to the type of the transaction data, according to classification for the transaction data into Row processing;
Stage decomposition is carried out according to the attribute information of the transaction data, the transaction data is handled stage by stage;
Increase the treating capacity of single transaction processing device;
Increase the quantity of transaction processing device;
Reduce the treating capacity of single transaction processing device;
Batch processing is carried out for the transaction data and merges update;
Debug transaction processing device performance;
Trading account where increase or split transactions data.
5. a kind of data processing equipment, which is characterized in that including:
Detection module is configured as obtaining the transaction data generated in process of exchange, and is detected accordingly according to prefixed time interval Transaction data, wherein the transaction data includes one or more of following:Transaction data generation information, Transaction data handles information, transaction data process performance information;
Starting module is configured to respond to the transaction data and is abnormal, starting guide processing operation;
Optimization module is configured as optimizing processing for the transaction data or transaction process flow.
6. device according to claim 5, which is characterized in that the detection module include following submodule it is in the block one or It is multiple:
First acquisition submodule is configured as obtaining transaction data generation information according to prefixed time interval, wherein the transaction Data generate information include it is following in it is one or more:Transaction data generated time, transaction data generation quantity and number of deals According to formation speed;
Second acquisition submodule is configured as obtaining transaction data processing information according to prefixed time interval, wherein the transaction Data processing of information include it is following in it is one or more:Transaction data processing starting, transaction data processing spend the time, Transaction data handles quantity and transaction data processing speed;
Third acquisition submodule is configured as obtaining transaction data process performance information according to prefixed time interval, wherein described Transaction data process performance information include it is following in it is one or more:Transaction processing device quantity, transaction processing device processing Amount and transaction processing device processing speed.
7. device according to claim 6, which is characterized in that the transaction data is abnormal including in following It is one or more of:
Transaction data formation speed is more than transaction data processing speed;
Transaction data formation speed in preset time period is more than first threshold;
Single transaction processing device treating capacity is higher than second threshold;
The instantaneous processing speed of single transaction processing device is less than third threshold value;
The average treatment speed of single transaction processing device is less than the 4th threshold value in preset time period;
Transaction processing device ratio in running order is higher than the 5th threshold value;
Single transaction processing device treating capacity is less than the 6th threshold value, and it is in running order in transaction processing device ratio be less than 7th threshold value.
8. device according to claim 5, which is characterized in that the optimization module include following submodule it is in the block one or It is several:
First optimization submodule, is configured as classifying for the transaction data according to the type of the transaction data, press The transaction data is handled according to classification;
Second optimization submodule, be configured as according to the attribute information of the transaction data carry out stage decomposition, stage by stage for The transaction data is handled;
Third optimizes submodule, is configured as increasing the treating capacity of single transaction processing device;
4th optimization submodule is configured as increasing the quantity of transaction processing device;
5th optimization submodule, is configured as reducing the treating capacity of single transaction processing device;
6th optimization submodule is configured as carrying out batch processing for the transaction data and merges update;
7th optimization submodule, is configured as debugging transaction processing device performance;
8th optimization submodule, the trading account being configured as where increase or split transactions data.
9. a kind of electronic equipment, which is characterized in that including memory and processor;Wherein,
The memory is for storing one or more computer instruction, wherein one or more computer instruction is by institute Processor is stated to execute to realize claim 1-4 any one of them method and steps.
10. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the computer instruction quilt Claim 1-4 any one of them method and steps are realized when processor executes.
CN201810322204.5A 2018-04-11 2018-04-11 Data processing method, device, electronic equipment and computer readable storage medium Pending CN108509266A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810322204.5A CN108509266A (en) 2018-04-11 2018-04-11 Data processing method, device, electronic equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810322204.5A CN108509266A (en) 2018-04-11 2018-04-11 Data processing method, device, electronic equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN108509266A true CN108509266A (en) 2018-09-07

Family

ID=63381610

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810322204.5A Pending CN108509266A (en) 2018-04-11 2018-04-11 Data processing method, device, electronic equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN108509266A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109242442A (en) * 2018-09-27 2019-01-18 拉扎斯网络科技(上海)有限公司 Task monitoring method, device, electronic equipment and computer readable storage medium
CN109831356A (en) * 2019-01-29 2019-05-31 网联清算有限公司 Data processing method, device, system, computer readable storage medium
CN110033324A (en) * 2019-04-11 2019-07-19 上海拉扎斯信息科技有限公司 Data processing method, device, electronic equipment and computer readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197015A (en) * 2017-05-23 2017-09-22 阿里巴巴集团控股有限公司 A kind of message treatment method and device based on Message Queuing system
CN107809480A (en) * 2017-10-25 2018-03-16 上海瀚银信息技术有限公司 One kind transaction commutation system
CN107819696A (en) * 2017-11-22 2018-03-20 中国银行股份有限公司 A kind of transaction flow control method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197015A (en) * 2017-05-23 2017-09-22 阿里巴巴集团控股有限公司 A kind of message treatment method and device based on Message Queuing system
CN107809480A (en) * 2017-10-25 2018-03-16 上海瀚银信息技术有限公司 One kind transaction commutation system
CN107819696A (en) * 2017-11-22 2018-03-20 中国银行股份有限公司 A kind of transaction flow control method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109242442A (en) * 2018-09-27 2019-01-18 拉扎斯网络科技(上海)有限公司 Task monitoring method, device, electronic equipment and computer readable storage medium
CN109831356A (en) * 2019-01-29 2019-05-31 网联清算有限公司 Data processing method, device, system, computer readable storage medium
CN110033324A (en) * 2019-04-11 2019-07-19 上海拉扎斯信息科技有限公司 Data processing method, device, electronic equipment and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN104657220B (en) Scheduling model and method based on deadline and expense restriction in mixed cloud
JP4768354B2 (en) Job management apparatus, job management method, and job management program
CN109949095A (en) Replenishing method and equipment
CN108509266A (en) Data processing method, device, electronic equipment and computer readable storage medium
US9582338B2 (en) Calculating a dispatcher's relative share based on relative queue length and capacity value of a plurality of workload types and computing systems combinations
CN110113387A (en) A kind of processing method based on distributed batch processing system, apparatus and system
CN108090225A (en) Operation method, device, system and the computer readable storage medium of database instance
CN110288255A (en) A kind of logistics method and device of distributed transaction
CN108734344A (en) Order dispenses prediction technique, device, equipment and computer readable storage medium
CN107515663A (en) The method and apparatus for adjusting central processor core running frequency
CN108154298A (en) Dispense method for allocating tasks, device, electronic equipment and computer storage media
El-Bouri A cooperative dispatching approach for minimizing mean tardiness in a dynamic flowshop
CN109669789A (en) Transaction queuing strategy, trading pit storage method, equipment and storage medium
CN108108940A (en) Cargo allocation amount determining method and device
CN110445755A (en) Hand over pregnable defence method, equipment and storage medium
CN109582445A (en) Message treatment method, device, electronic equipment and computer readable storage medium
Kress et al. Mechanism design for machine scheduling problems: Classification and literature overview
CN109543988A (en) The method, apparatus and storage medium of optimization transaction overtime threshold
CN108197825A (en) System scheduling method and device
CN107886424A (en) Settlement data treating method and apparatus, computer equipment and storage medium
US9319291B2 (en) Server system, management device, server management method, and program
CN110471769A (en) A kind of method for managing resource and device of virtual machine
CN109376043A (en) A kind of method and apparatus of equipment monitoring
CN109242442A (en) Task monitoring method, device, electronic equipment and computer readable storage medium
CN107357679A (en) A kind of backup method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180907

RJ01 Rejection of invention patent application after publication