CN109445928A - A kind of access request processing method, device, equipment and readable storage medium storing program for executing - Google Patents
A kind of access request processing method, device, equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN109445928A CN109445928A CN201811356179.9A CN201811356179A CN109445928A CN 109445928 A CN109445928 A CN 109445928A CN 201811356179 A CN201811356179 A CN 201811356179A CN 109445928 A CN109445928 A CN 109445928A
- Authority
- CN
- China
- Prior art keywords
- task
- processing
- access request
- classification
- classification task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4812—Task transfer initiation or dispatching by interrupt, e.g. masked
- G06F9/4818—Priority circuits therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/48—Indexing scheme relating to G06F9/48
- G06F2209/484—Precedence
Abstract
The invention discloses a kind of access request processing methods, method includes the following steps: receiving the access request that user sends, and determine the corresponding processing task of access request；If processing task is consuming task, processing task is cut according to tasks execution phases, obtains corresponding classification task of each execution stage；According to corresponding sequencing of each execution stage, each classification task is respectively processed, successively obtains the processing result of each classification task；Each processing result is presented on visualization interface respectively, and audit log is written into each processing result.So that user understands Task Progress and executive condition.In addition, also processing result is written in audit log, by consulting audit log, to be quickly and accurately positioned problem, be conducive to Breakdown Maintenance when to execute failure or executing failure.The invention also discloses a kind of access request processing unit, equipment and readable storage medium storing program for executing, have corresponding technical effect.
Description
Technical field
The present invention relates to computer application technologies, more particularly to a kind of access request processing method, device, equipment
And readable storage medium storing program for executing.
Background technique
Under mass data environment, the initial data accumulated in production and living data exponentially increases, data scale and
Complexity also improves rapidly.The distributed memory system and Clustering to come into being also becomes more and more important.In the extension to system
Property high adaptation while, also the management of distributed type assemblies and O&M are required also higher and higher and more and more important.And it is distributed
In storage system, different nodes are connected in a network environment and execute system task jointly, for different degrees of consuming task
Management also become a critical function.
Currently, in distributed memory system, after the processing of consuming task corresponding for access request is often shown
It holds in the optimization of service logic and the aid of the high-performance algorithm of performance structure program.Wherein, processing logic passes through log etc.
Method records operating process.Without loss of generality, the unified management and Row control that these design or methods lack, often result in
The concrete missing of operation note and task status tracking are limited, and it is tired then to trigger a series of O&Ms difficulties, positioning problems
Difficult, misoperation triggers the problems such as serious service fault.
In conclusion the problems such as how effectively handling the access request of consuming task, is current those skilled in the art
Technical problem urgently to be solved.
Summary of the invention
The object of the present invention is to provide a kind of access request processing method, device, equipment and readable storage medium storing program for executing, with to
In the access request at family, unified management and the Row control of the consuming task of processing are requested.
In order to solve the above technical problems, the invention provides the following technical scheme:
A kind of access request processing method, comprising:
The access request that user sends is received, and determines the corresponding processing task of the access request；
If the processing task is consuming task, the processing task is cut according to tasks execution phases, is obtained
Obtain corresponding classification task of each execution stage；
According to corresponding sequencing of each execution stage, each classification task is respectively processed, according to
The secondary processing result for obtaining each classification task；
Each processing result is presented on visualization interface respectively, and each processing result write-in is audited day
Will.
Preferably, according to corresponding sequencing of each execution stage, each classification task is carried out respectively
Processing, successively obtains the processing result of each classification task, comprising:
If the processing result is classification task execution failure, the classification is retried using recursive call execution and is appointed
It is engaged in corresponding operating procedure；
If running succeeded during retrying, then continue to execute described corresponding successively according to each execution stage
Sequentially, the step of each classification task being respectively processed.
Preferably, it is executed described using recursive call after retrying the corresponding operating procedure of the classification task, is also wrapped
It includes:
If executing failure during retrying, then rolling back action is carried out to the processing task；
Wherein, the rolling back action be repeat it is described according to corresponding sequencing of each execution stage, it is right
The step of each classification task is respectively processed, and successively obtains the processing result of each classification task.
Preferably, described that each processing result is presented on visualization interface respectively, and each processing is tied
Audit log is written in fruit, comprising:
The processing result is then presented on the visualization interface by one processing result of every acquisition, and will be described
The audit log is written in processing result.
Preferably, described according to corresponding sequencing of each execution stage, each classification task is distinguished
It is handled, comprising:
It reads target and is classified task, and judge the target classification task in the execution stage corresponding sequencing
With the presence or absence of upper classification task；
If it is present judging whether a upper classification task is performed success；
If a upper classification task is performed success, the corresponding target processing thread of the target classification task is enabled
Execute the target classification task；
Wherein, the target classification task is any one in the corresponding classification task of the processing task.
Preferably, it is classified task in the reading target, and judges the target classification task in the execution stage pair
With the presence or absence of after a upper classification task in the sequencing answered, further includes:
If it does not exist, then the directly corresponding target processing thread of target classification task described in the writ of execution executes the target
The step of classification task.
It is preferably, described to judge whether a upper classification task is performed success, comprising:
The processing result of the upper classification task is read from the audit log；
Judge whether a upper classification task is performed success using the processing result.
A kind of access request processing unit, comprising:
Processing task determining module for receiving the access request of user's transmission, and determines that the access request is corresponding
Processing task；
Task divides module, if being consuming task for the processing task, according to tasks execution phases to the place
Reason task is cut, and corresponding classification task of each execution stage is obtained；
Task execution module, for appointing to each classification according to corresponding sequencing of each execution stage
Business is respectively processed, and successively obtains the processing result of each classification task；
Processing result logging modle, for each processing result to be presented on visualization interface respectively, and will be each
Audit log is written in the processing result.
A kind of access request processing equipment, comprising:
Memory, for storing computer program；
Processor, the step of above-mentioned access request processing method is realized when for executing the computer program.
A kind of readable storage medium storing program for executing is stored with computer program, the computer program quilt on the readable storage medium storing program for executing
The step of processor realizes above-mentioned access request processing method when executing.
Using method provided by the embodiment of the present invention, when receiving the access request of user's transmission, it is first determined visit
Ask request corresponding processing task.And then judge whether processing task is consuming task, if processing task is consuming task, press
Processing task is cut according to tasks execution phases, obtains corresponding classification task of each execution stage.Then, according to
Each execution stage corresponding sequencing, is respectively processed each classification task, successively obtains each classification task
Processing result；Each processing result is presented on visualization interface respectively, and audit log is written into each processing result.
That is, when the corresponding processing task of access request is consuming task, in order to enhance the system to consuming task
One management and process/logic control, processing task is split according to tasks execution phases, different tasks is can be obtained and holds
The corresponding classification task of row order section.According to corresponding sequencing of each execution stage, classification task can be handled respectively,
The processing result of acquisition is successively presented on the visualization stage, so that user understands Task Progress and executive condition.In addition, also
By processing result be written audit log in, so as to execute failure or execute failure when, by consult audit log, quick and precisely
Ground orientation problem, is conducive to Breakdown Maintenance.
Correspondingly, the embodiment of the invention also provides access request corresponding with above-mentioned access request processing method processing
Device, equipment and readable storage medium storing program for executing, have above-mentioned technique effect, and details are not described herein.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of implementation flow chart of access request processing method in the embodiment of the present invention；
Fig. 2 is a kind of task attribute database E-R figure in the embodiment of the present invention；
Fig. 3 is a kind of consuming task process flow diagram in the embodiment of the present invention；
Fig. 4 is a kind of timing diagram of the consuming task treatment process of modularization in the embodiment of the present invention；
Fig. 5 is a kind of structural schematic diagram of access request processing unit in the embodiment of the present invention；
Fig. 6 is a kind of structural schematic diagram of access request processing equipment in the embodiment of the present invention；
Fig. 7 is a kind of concrete structure schematic diagram of access request processing equipment in the embodiment of the present invention.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, with reference to the accompanying drawings and detailed description
The present invention is described in further detail.Obviously, described embodiments are only a part of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Embodiment one:
Referring to FIG. 1, Fig. 1 is a kind of flow chart of access request processing method in the embodiment of the present invention, this method can be answered
For in distributed memory system, method includes the following steps:
S101, the access request that user sends is received, and determines the corresponding processing task of access request.
The client that user can be provided by operation distributed memory system, sends access to distributed memory system and asks
It asks.Specifically, the access request can be the corresponding access request of CRUD, wherein CRUD refers to the increase when doing calculation processing
(Create), the initial for reading inquiry (Read), update (Update) and deletion (Delete) several words is write a Chinese character in simplified form, mainly quilt
The basic operational functions of database or persistent layer in description software systems.
After distributed memory system receives the access request of user's transmission, it may be determined that go out the corresponding place of access request
Reason task.For example, handling task then includes to carry out to data A if the access request of user is specially to modify to data A
During the task execution of modification, the corresponding processing operation of each tasks execution phases, if tasks execution phases include: to prepare
The common tasks execution phases such as stage, pretreatment stage, processing stage.
If S102, processing task are consuming task, processing task is cut according to tasks execution phases, is obtained each
A execution stage corresponding classification task.
After determining processing task, can determine whether processing task is consuming task.Specifically, at can be by calculating
Then the summation of the estimated time of each processing step in reason task carries out estimated time summation and preset time-consuming threshold value
Compare, if estimated time summation is greater than time-consuming threshold value, it is determined that the processing task is consuming task, wherein each processing step
Estimated time and time-consuming threshold value can be preset.Certainly, whether the type that can also only judge the processing task is preset
The corresponding type of consuming task, determine the processing task whether consuming task, wherein the corresponding type of consuming task can be set in advance
It sets, such as consuming task can be set by reading processing, modification processing.
When determining processing task is consuming task, then processing task can be cut according to tasks execution phases.Example
Such as, if the corresponding tasks execution phases of processing task include preparation stage, processing stage, by processing corresponding in processing task
Step is divided according to corresponding tasks execution phases, obtains the preparation stage, processing stage corresponding classification is appointed
Business.Certainly, the tasks execution phases for handling task may also include the execution stage such as preproduction phase, processing stage and ending phase.
It should be noted that after being split to processing task, the summation of all steps in resulting classification task
Should be consistent in the corresponding processing step of processing task, that is, divide the integrality for not destroying processing task.
S103, according to corresponding sequencing of each execution stage, each classification task is respectively processed, is successively obtained
Obtain the processing result of each classification task.
When executing each classification task, in order not to destroy the internal logic of processing task, should be installed each execution stage
Corresponding sequencing is processed.For example, executing stage A and executing stage B in processing task, execution stage A need to be first completed
Operation after, could to execute stage B the step of operate, after it will handle task and be divided, obtain execution rank
After the corresponding classification task 1 of section A, and execution stage corresponding classification task 2, when handling classification task,
Classification task 1 need to be first carried out, then executes classification task 2.
When successively executing each classification task, the processing result of each classification task can be obtained, specifically, processing knot
Fruit is the result for being classified task execution success or not.
S104, each processing result is presented on visualization interface respectively, and audit log is written into each processing result.
After obtaining processing result, each processing stage can be presented on visualization interface respectively, so as to user's understanding
The executive condition of processing task.Processing result can be also written in audit log, to utilize when task execution breaks down
The information recorded in audit log, quick positioning question.
Preferably, in order to allow user to understand the implementation progress and disposition of processing task in real time, by processing result
When being presented on visualization interface, can also one processing result of every acquisition, then processing result is presented on visualization interface, and will place
It manages result and audit log is written.
Using method provided by the embodiment of the present invention, when receiving the access request of user's transmission, it is first determined visit
Ask request corresponding processing task.And then judge whether processing task is consuming task, if processing task is consuming task, press
Processing task is cut according to tasks execution phases, obtains corresponding classification task of each execution stage.Then, according to
Each execution stage corresponding sequencing, is respectively processed each classification task, successively obtains each classification task
Processing result；Each processing result is presented on visualization interface respectively, and audit log is written into each processing result.
That is, when the corresponding processing task of access request is consuming task, in order to enhance the system to consuming task
One management and process/logic control, processing task is split according to tasks execution phases, different tasks is can be obtained and holds
The corresponding classification task of row order section.According to corresponding sequencing of each execution stage, classification task can be handled respectively,
The processing result of acquisition is successively presented on the visualization stage, so that user understands Task Progress and executive condition.In addition, also
By processing result be written audit log in, so as to execute failure or execute failure when, by consult audit log, quick and precisely
Ground orientation problem, is conducive to Breakdown Maintenance.
It should be noted that based on the above embodiment, the embodiment of the invention also provides be correspondingly improved scheme.Excellent
It can mutually be referred between step or corresponding steps same with the above-mentioned embodiment involved in choosing/improvement embodiment, it is corresponding beneficial
Effect can also be cross-referenced, no longer repeats one by one in preferred/improvement embodiment of this paper.
Preferably, it is contemplated that handle task implementation procedure may failure or execute failure the case where, in order to solve this
One problem, the embodiment of the invention also provides following solutions:
When executing step S103, i.e., according to corresponding sequencing of each execution stage, each classification task is distinguished
It is handled, during the processing result for successively obtaining each classification task, following failure rollback retry mechanism can be performed:
Step 1: retrying classification task pair using recursive call execution if processing result is classification task execution failure
The operating procedure answered；
Step 2: then being continued to execute corresponding successively suitable according to each execution stage if running succeeded during retrying
Sequence, the step of being respectively processed to each classification task.
For ease of description, above-mentioned two step is combined below and is illustrated.
When handling each classification task, when every acquisition one is classified the processing result of task, using processing
As a result judge whether successful execution executes using recursive call if failing execution and retry the classification task task
Corresponding operating procedure.Specifically, may also be combined with lock mechanism when retrying operating procedure using recursive call execution, repetition is held
The row operating procedure.It can usually retry 3 times, the number of other numerical value can also be set as according to specific user demand certainly.If
It during retrying, runs succeeded, then can continue according to corresponding sequencing of each execution stage to each classification task point
It is not handled.It only after being classified task execution failure, and repeats to run succeeded, then it is corresponding to continue to execute current classification task
Next processing task.
Preferably, it is contemplated that classification task execution unsuccessfully also ceases manner of breathing with running environment, the computer resource etc. when executing
It closes, therefore, after execution failure is repeated several times, can also rolling back action be carried out to processing task, to complete the processing task.
Specifically, i.e. after retrying the corresponding operating procedure of classification task using recursive call execution, if being executed during retrying
Failure then carries out rolling back action to processing task；Wherein, rolling back action is to repeat according to corresponding elder generation of each execution stage
Sequence afterwards, the step of being respectively processed to each classification task, successively obtain the processing result of each classification task.
That is, when repeat the corresponding classification task of a certain tasks execution phases can not successful execution when, can be right
Processing task carries out rollback, can be rolled back to step S103 at this time, can also directly be rolled back to step S102.That is, can be rolled back to
One classification task is handled, and can also be divided again to processing task.
Preferably due to handling task is divided into corresponding classification task of each execution stage, and to classification task into
After row processing, its processing result can be recorded in audit log.It therefore, can also be to the different corresponding processing of access request
Task carries out parallel processing.Specifically, a target treatment progress, the i.e. process can be respectively set only for the different execution stages
Execute a kind of execution stage corresponding phased mission.According to corresponding sequencing of each execution stage, each classification is appointed
Business is respectively processed, specifically:
Step 1: reading target is classified task, and judge target classification task in execution stage corresponding sequencing
With the presence or absence of upper classification task；
Step 2: if it is present judging whether a upper classification task is performed success；
Step 3: enabling the corresponding target processing thread of target classification task if a upper classification task is performed success
Performance objective is classified task；
Wherein, target classification task is any one in the corresponding classification task of processing task.
It is illustrated for ease of description, below combining above three step.
If consuming task is divided into 4 stages, target treatment progress is respectively set for this 4 stages.When receiving
After access request, be determined as the corresponding processing task of access request be consuming task when, processing task is divided into 4 classifications
Task.Then this 4 classification task process are handled using 4 target treatment progress respectively.Appoint when there is large batch of time-consuming
When business, large batch of consuming task can then be handled using 4 target treatment progress.Process creation quantity can be reduced.
Specifically, be the processing logic for not destroying processing task when target treatment progress handles classification task, it can be from finger
Determine in memory space read target classification task, and judge target classification task in execution stage corresponding sequencing whether
There are a upper classification tasks；If it is present judging whether a upper classification task is performed success；If a upper classification is appointed
Business is performed success, then enables the corresponding target processing thread performance objective classification task of target classification task.
Wherein, judge whether a upper classification task is performed success, upper one point is specially read from audit log
The processing result of grade task；Judge whether a upper classification task is performed success using processing result.
Preferably, target classification task is being read, and is judging target classification task in execution stage corresponding sequencing
In with the presence or absence of after a upper classification task, if it does not exist, then directly at the corresponding target of writ of execution target classification task
Lineation journey performance objective is classified the step of task.I.e. when target classification task is in processing task according to first of the stage of execution
When classification task, then the task can be performed.
Embodiment two:
To more fully understand technical solution provided by the embodiment of the present invention convenient for those skilled in the art, below with application
The consuming task treatment process of the technical solution is described in detail.
The consuming task treatment process can be applied in distributed memory system.Consuming task treatment process module is turned to
Module, asynchronous task module and failure roll-back module is presented in front end, and is deployed in distributed memory system.
Wherein, module is presented in front end: the module mainly includes three parts: Task Progress manager, historic task management
Device and audit log, three modules are presented to the user as three functions of client.Wherein, Task Progress manager provides consumption
When execution status of task and real-time progress the functions such as check；Historic task manager provides all task (successes for executing and terminating
And failure) task details, execute the specific CRUD function such as time and description；Audit log then completely has recorded the time-consuming
Task executes the intermediate process step of all user's operations during terminating from being created to.
The Task Progress manager of module is presented in front end and historic task manager is interacted with database, presents in database
Corresponding data；Audit log then passes through definition journal format, and data are parsed from journal file and are presented.Specific data format design
It is as follows:
Task Progress manager and historic task manager provide the attribute information of task, and Task Progress manager can be looked into
The real-time update progress for seeing task, at the end of task execution (unsuccessfully or successfully), then the task is removed from task manager, from
It is dynamic to be moved in historic task manager.
For the differentiation characteristic, task data, but two data library texts are saved using two different database files
Tables of data and structure are consistent in part.
The E-R figure such as Fig. 2 is specifically referred to, wherein Fig. 2 is a kind of task attribute database E-R in the embodiment of the present invention
Figure.
The task attribute of task mainly includes field as shown in Table 1:
| Field name | Type | Remarks |
| Id | Integer, integer | Task ID, major key, unique identifier |
| Name | Varchar, character string | Task names |
| State | Varchar, character string | Task status |
| Process | Varchar, character string | Progress: 0-100 |
| Usemame | Varchar, character string | User name |
| Start_time | Varchar, character string | Time started |
| End_time | Varchar, character string | End time |
| Description | Varchar, character string | Task description |
| Pid | Varchar, character string | Task process id |
Table 1
Wherein, task status may particularly include 3 kinds of numerical value such as: 1:running indicate to be currently running；0:completed,
Expression is completed；- 1:failed indicates failure；Task description specifically can description object to be specifically defined include: task rank
(Info, Warnning, Critical), object oriented, place node and specific descriptions information.
Audit log completely have recorded the consuming task from be created to execute terminate during all user's operations in
Between process step, and use defined log record, to guarantee that the page can correctly parse display.It can be by audit log lattice
Formula is defined as format as shown in Table 2:
| Time | Module title | Log rank | Log description |
Table 2
Wherein, such as " [] " or other common symbols can be used to be wrapped up, be spaced between each field of audit log.
It should be noted that the execution process of asynchronous task module and failure roll-back module can refer to Fig. 3, Fig. 3 is this hair
A kind of consuming task process flow diagram in bright embodiment.Interactively communicating between modules, can refer to Fig. 4, and Fig. 4 is the present invention
A kind of timing diagram of the consuming task treatment process of modularization in embodiment.Wherein, the network in Fig. 4 and request forwarding module
Also inside modules module can be presented for front end.
Asynchronous task module: the module be mainly responsible for consuming task execute processing, be connected to front end present module and
Failure roll-back module, same mainly includes three parts: task classification, task execution and front end, which are presented, to be updated.Task classification is negative
Duty cuts the consuming task of creation according to step is executed, and segmentation task is the different stage, and uses unified task
Classification marking (mainly including task names, stage name, the stage executes the time, phased mission executes description etc.) carries out modularization
It is corresponding that module is presented in label, the part and front end；Task execution part is then classified according to task and is classified the choosing of stage implementing result
The task of selecting continues to execute or failure rollback, while notifying and updating related pages involved in front end presentation module；Front end is in
It now updates part to be then responsible for being classified task the update of part implementing result, refreshes front end and module is presented.
The detailed process of the module is as follows:
Step11: asynchronous task module receives newly-built task and is placed on running background.
Step12: according to consuming task step, task classification mark is carried out, and encapsulation task executes step.
Step13: each task classification stage etch runs succeeded, then update accordingly front end present the task of module into
Manager description information is spent, and records audit log；Otherwise, turn STEP14.
Step14: task classification stage etch executes failure, then task turns to the processing of failure roll-back module.
Step15: entire task execution terminates (unsuccessfully or successfully), to update the Task Progress manager that module is presented in front end
Progress, state and description information, and task is moved in historic task manager, while recording audit log.
Failure roll-back module: the task classification step that the module is responsible for executing the task classification stage failure carries out failure time
Rolling operation, by task be classified in completed step rollback, enable task execution fail when by task operating be rolled back to appoint
State before business creates.Retry mechanism is also provided unsuccessfully simultaneously in the module, then retries this when task classification step executes failure
The certain number of step carrys out the fault-tolerance of further lifting system.
Spet21: task classification step executes failure, then startup separator rollback retry mechanism.
Step22: being directed to the execution step, retries the step (generally retrying 3 times) using recursive call execution.
Step23: if run succeeded during retrying, continuing to execute task step, updates front end and module is presented.
Step24: if retrying 3 times still executes failure, rollback mechanism is activated.
Step25: operating before the previous steps recovery tasks of task classification, and updates front end and module is presented.
STEP26: it if rollback process fails, updates front end and module is presented, task terminates；Otherwise, continue rollback until
Recovering step is completed, and updates front end and module is presented.
Embodiment three:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of access request processing units, hereafter
The access request processing unit of description can correspond to each other reference with above-described access request processing method.
Shown in Figure 5, which comprises the following modules:
Processing task determining module 101 for receiving the access request of user's transmission, and determines the corresponding place of access request
Reason task；
Task divides module 102, if being consuming task for handling task, according to tasks execution phases to processing task
It is cut, obtains corresponding classification task of each execution stage；
Task execution module 103, for distinguishing each classification task according to corresponding sequencing of each execution stage
It is handled, successively obtains the processing result of each classification task；
Processing result logging modle 104, for each processing result to be presented on visualization interface respectively, and by each place
It manages result and audit log is written.
Using device provided by the embodiment of the present invention, when receiving the access request of user's transmission, it is first determined visit
Ask request corresponding processing task.And then judge whether processing task is consuming task, if processing task is consuming task, press
Processing task is cut according to tasks execution phases, obtains corresponding classification task of each execution stage.Then, according to
Each execution stage corresponding sequencing, is respectively processed each classification task, successively obtains each classification task
Processing result；Each processing result is presented on visualization interface respectively, and audit log is written into each processing result.
That is, when the corresponding processing task of access request is consuming task, in order to enhance the system to consuming task
One management and process/logic control, processing task is split according to tasks execution phases, different tasks is can be obtained and holds
The corresponding classification task of row order section.According to corresponding sequencing of each execution stage, classification task can be handled respectively,
The processing result of acquisition is successively presented on the visualization stage, so that user understands Task Progress and executive condition.In addition, also
By processing result be written audit log in, so as to execute failure or execute failure when, by consult audit log, quick and precisely
Ground orientation problem, is conducive to Breakdown Maintenance.
In a kind of specific embodiment of the invention, task execution module 103, if being specifically used for processing result is classification
Task execution failure then retries the corresponding operating procedure of classification task using recursive call execution；If being executed during retrying
Success, then continue to execute according to corresponding sequencing of each execution stage, the step being respectively processed to each classification task
Suddenly.
In a kind of specific embodiment of the invention, further includes:
Failure rollback retries module, for using recursive call execution retry the corresponding operating procedure of classification task it
Afterwards, if during retrying, failure is executed, then rolling back action is carried out to processing task；Wherein, rolling back action be repeat by
According to corresponding sequencing of each execution stage, each classification task is respectively processed, successively obtains each classification task
Processing result the step of.
In a kind of specific embodiment of the invention, processing result logging modle 104 is specifically used for every obtain at one
Reason is as a result, be then presented on visualization interface for processing result, and audit log is written in processing result.
In a kind of specific embodiment of the invention, task execution module 103 is specifically used for reading target classification times
Business, and judge target classification task in execution stage corresponding sequencing with the presence or absence of a upper classification task；If deposited
Then judging whether a upper classification task is performed success；
If a upper classification task is performed success, the corresponding target processing thread performance objective of target classification task is enabled
Classification task；Wherein, target classification task is any one in the corresponding classification task of processing task.
In a kind of specific embodiment of the invention, further includes:
Roll-back module for reading target classification task, and judges target classification task in execution stage corresponding elder generation
After whether there is a upper classification task in sequence afterwards, if it does not exist, then directly writ of execution target classification task is corresponding
Target handles the step of thread performance objective classification task.
In a kind of specific embodiment of the invention, roll-back module, specifically for reading upper one from audit log
The processing result of classification task；Judge whether a upper classification task is performed success using processing result.
Example IV:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of access request processing equipments, hereafter
A kind of access request processing equipment of description can correspond to each other reference with a kind of above-described access request processing method.
Shown in Figure 6, which includes:
Memory D1, for storing computer program；
Processor D2 realizes the step of the access request processing method of above method embodiment when for executing computer program
Suddenly.
Specifically, referring to FIG. 7, for a kind of specific structure signal of access request processing equipment provided in this embodiment
Figure, the access request processing equipment can generate bigger difference because configuration or performance are different, may include one or one
The above processor (central processing units, CPU) 322 (for example, one or more processors) and storage
Device 332, one or more storage application programs 342 or data 344 storage medium 330 (such as one or more
Mass memory unit).Wherein, memory 332 and storage medium 330 can be of short duration storage or persistent storage.It is stored in storage
The program of medium 330 may include one or more modules (diagram does not mark), and each module may include at data
Manage the series of instructions operation in equipment.Further, central processing unit 322 can be set to communicate with storage medium 330,
The series of instructions operation in storage medium 330 is executed in access request processing equipment 301.
Access request processing equipment 301 can also include one or more power supplys 326, one or more are wired
Or radio network interface 350, one or more input/output interfaces 358, and/or, one or more operating systems
341.For example, Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
Step in access request processing method as described above can be realized by the structure of access request processing equipment.
Embodiment five:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of readable storage medium storing program for executing, are described below
A kind of readable storage medium storing program for executing can correspond to each other reference with a kind of above-described access request processing method.
A kind of readable storage medium storing program for executing is stored with computer program on readable storage medium storing program for executing, and computer program is held by processor
The step of access request processing method of above method embodiment is realized when row.
The readable storage medium storing program for executing be specifically as follows USB flash disk, mobile hard disk, read-only memory (Read-Only Memory,
ROM), the various program storage generations such as random access memory (Random Access Memory, RAM), magnetic or disk
The readable storage medium storing program for executing of code.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
Claims (10)
1. a kind of access request processing method characterized by comprising
The access request that user sends is received, and determines the corresponding processing task of the access request；
If the processing task is consuming task, the processing task is cut according to tasks execution phases, is obtained each
A execution stage corresponding classification task；
According to corresponding sequencing of each execution stage, each classification task is respectively processed, is successively obtained
Obtain the processing result of each classification task；
Each processing result is presented on visualization interface respectively, and audit log is written into each processing result.
2. access request processing method according to claim 1, which is characterized in that corresponding according to each execution stage
Sequencing, each classification task is respectively processed, the processing result of each classification task is successively obtained,
Include:
If the processing result is classification task execution failure, the classification task pair is retried using recursive call execution
The operating procedure answered；
If running succeeded during retrying, then continue to execute it is described according to corresponding sequencing of each execution stage,
The step of each classification task is respectively processed.
3. access request processing method according to claim 2, which is characterized in that execute weight using recursive call described
After trying the corresponding operating procedure of the classification task, further includes:
If executing failure during retrying, then rolling back action is carried out to the processing task；
Wherein, the rolling back action be repeat it is described according to corresponding sequencing of each execution stage, to each
The step of classification task is respectively processed, and successively obtains the processing result of each classification task.
4. access request processing method according to claim 1, which is characterized in that described respectively to tie each processing
Fruit is presented on visualization interface, and audit log is written in each processing result, comprising:
The processing result is then presented on the visualization interface by one processing result of every acquisition, and by the processing
As a result the audit log is written.
5. access request processing method according to any one of claims 1 to 4, which is characterized in that described according to each institute
Execution stage corresponding sequencing is stated, each classification task is respectively processed, comprising:
Read target and be classified task, and judge target classification task in the execution stage corresponding sequencing whether
There are a upper classification tasks；
If it is present judging whether a upper classification task is performed success；
If a upper classification task is performed success, the corresponding target processing thread of the target classification task is enabled to execute
The target is classified task；
Wherein, the target classification task is any one in the corresponding classification task of the processing task.
6. access request processing method according to claim 5, which is characterized in that it is classified task in the reading target,
And judge target classification task in the execution stage corresponding sequencing with the presence or absence of a upper classification task it
Afterwards, further includes:
If it does not exist, then the directly corresponding target processing thread of target classification task described in the writ of execution executes the target classification
The step of task.
7. access request processing method according to claim 5, which is characterized in that a judgement upper classification is appointed
Whether business is performed success, comprising:
The processing result of the upper classification task is read from the audit log；
Judge whether a upper classification task is performed success using the processing result.
8. a kind of access request processing unit characterized by comprising
Processing task determining module for receiving the access request of user's transmission, and determines the corresponding processing of the access request
Task；
Task divides module, if being consuming task for the processing task, appoints according to tasks execution phases to the processing
Business is cut, and corresponding classification task of each execution stage is obtained；
Task execution module, for according to corresponding sequencing of each execution stage, to each classification task point
It is not handled, successively obtains the processing result of each classification task；
Processing result logging modle, for each processing result to be presented on visualization interface respectively, and will be each described
Audit log is written in processing result.
9. a kind of access request processing equipment characterized by comprising
Memory, for storing computer program；
Processor realizes the access request processing side as described in any one of claim 1 to 7 when for executing the computer program
The step of method.
10. a kind of readable storage medium storing program for executing, which is characterized in that be stored with computer program, the meter on the readable storage medium storing program for executing
It is realized when calculation machine program is executed by processor as described in any one of claim 1 to 7 the step of access request processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811356179.9A CN109445928A (en) | 2018-11-14 | 2018-11-14 | A kind of access request processing method, device, equipment and readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811356179.9A CN109445928A (en) | 2018-11-14 | 2018-11-14 | A kind of access request processing method, device, equipment and readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109445928A true CN109445928A (en) | 2019-03-08 |
Family
ID=65553483
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811356179.9A Pending CN109445928A (en) | 2018-11-14 | 2018-11-14 | A kind of access request processing method, device, equipment and readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109445928A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825526A (en) * | 2019-11-08 | 2020-02-21 | 欧冶云商股份有限公司 | Distributed scheduling method and device based on ER relationship, equipment and storage medium |
| CN110908793A (en) * | 2019-09-30 | 2020-03-24 | 北京辰森世纪科技股份有限公司 | Long-time task execution method, device, equipment and readable storage medium |
| CN110990145A (en) * | 2019-10-31 | 2020-04-10 | 北京浪潮数据技术有限公司 | Background task processing mechanism and method for distributed system |
| CN112685145A (en) * | 2019-10-18 | 2021-04-20 | 上海哔哩哔哩科技有限公司 | Task management method and device and computer equipment |
| CN112738057A (en) * | 2020-12-24 | 2021-04-30 | 深圳市高德信通信股份有限公司 | Data exchange control method based on network control |
| CN112948408A (en) * | 2021-03-04 | 2021-06-11 | 上海哔哩哔哩科技有限公司 | Data processing method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582043A (en) * | 2008-05-16 | 2009-11-18 | 华东师范大学 | Dynamic task allocation method of heterogeneous computing system |
| CN101794215A (en) * | 2010-03-05 | 2010-08-04 | 北京红旗胜利科技发展有限责任公司 | Method and device for assembling and performing complex tasks |
| CN104216785A (en) * | 2014-08-26 | 2014-12-17 | 烽火通信科技股份有限公司 | Common policy task system and implementing method thereof |
| CN104239144A (en) * | 2014-09-22 | 2014-12-24 | 珠海许继芝电网自动化有限公司 | Multilevel distributed task processing system |
| CN106095585A (en) * | 2016-06-22 | 2016-11-09 | 中国建设银行股份有限公司 | Task requests processing method, device and enterprise information system |
| CN106156198A (en) * | 2015-04-22 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Task executing method based on distributed data base and device |
| CN106445681A (en) * | 2016-08-31 | 2017-02-22 | 东方网力科技股份有限公司 | Distributed task scheduling system and method |
| CN106874094A (en) * | 2017-02-17 | 2017-06-20 | 广州爱九游信息技术有限公司 | timed task processing method, device and computing device |
-
2018
- 2018-11-14 CN CN201811356179.9A patent/CN109445928A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582043A (en) * | 2008-05-16 | 2009-11-18 | 华东师范大学 | Dynamic task allocation method of heterogeneous computing system |
| CN101794215A (en) * | 2010-03-05 | 2010-08-04 | 北京红旗胜利科技发展有限责任公司 | Method and device for assembling and performing complex tasks |
| CN104216785A (en) * | 2014-08-26 | 2014-12-17 | 烽火通信科技股份有限公司 | Common policy task system and implementing method thereof |
| CN104239144A (en) * | 2014-09-22 | 2014-12-24 | 珠海许继芝电网自动化有限公司 | Multilevel distributed task processing system |
| CN106156198A (en) * | 2015-04-22 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Task executing method based on distributed data base and device |
| CN106095585A (en) * | 2016-06-22 | 2016-11-09 | 中国建设银行股份有限公司 | Task requests processing method, device and enterprise information system |
| CN106445681A (en) * | 2016-08-31 | 2017-02-22 | 东方网力科技股份有限公司 | Distributed task scheduling system and method |
| CN106874094A (en) * | 2017-02-17 | 2017-06-20 | 广州爱九游信息技术有限公司 | timed task processing method, device and computing device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908793A (en) * | 2019-09-30 | 2020-03-24 | 北京辰森世纪科技股份有限公司 | Long-time task execution method, device, equipment and readable storage medium |
| CN112685145A (en) * | 2019-10-18 | 2021-04-20 | 上海哔哩哔哩科技有限公司 | Task management method and device and computer equipment |
| CN110990145A (en) * | 2019-10-31 | 2020-04-10 | 北京浪潮数据技术有限公司 | Background task processing mechanism and method for distributed system |
| CN110825526A (en) * | 2019-11-08 | 2020-02-21 | 欧冶云商股份有限公司 | Distributed scheduling method and device based on ER relationship, equipment and storage medium |
| CN112738057A (en) * | 2020-12-24 | 2021-04-30 | 深圳市高德信通信股份有限公司 | Data exchange control method based on network control |
| CN112948408A (en) * | 2021-03-04 | 2021-06-11 | 上海哔哩哔哩科技有限公司 | Data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109445928A (en) | A kind of access request processing method, device, equipment and readable storage medium storing program for executing | |
| EP3120261B1 (en) | Dependency-aware transaction batching for data replication | |
| CN107220142B (en) | Method and device for executing data recovery operation | |
| CN108874588A (en) | A kind of database instance restoration methods and device | |
| US20150205850A1 (en) | Eager replication of uncommitted transactions | |
| EP4006740A1 (en) | Method for indexing data in storage engines, and related device | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| CN105787058B (en) | A kind of user tag system and the data delivery system based on user tag system | |
| CN107122361A (en) | Data mover system and method | |
| CN108369599A (en) | Duplication control between redundant data center | |
| CN108431807A (en) | The duplication of structured data in partition data memory space | |
| CN109643310A (en) | System and method for fast resampling in database | |
| CN108431808A (en) | Prompting processing to the structured data in the data space of subregion | |
| CN109558213A (en) | The method and apparatus for managing the virtual machine snapshot of OpenStack platform | |
| EP3396560A1 (en) | Database operating method and device | |
| CN111782452A (en) | Method, system, device and medium for interface contrast test | |
| EP3396542B1 (en) | Database operating method and device | |
| CN106802928B (en) | Power grid historical data management method and system | |
| CN111143323A (en) | MPP database management method, device and system | |
| CN109992476A (en) | A kind of analysis method of log, server and storage medium | |
| CN109359205A (en) | A kind of remote sensing image cutting method and equipment based on geographical grid | |
| US8056052B2 (en) | Populating service requests | |
| CN107577802A (en) | A kind of data base management method and device | |
| CN110990145A (en) | Background task processing mechanism and method for distributed system | |
| CN103488549B (en) | Roll-back processing system and roll-back processing method for multi-mirror-image data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190308 |