CN110245029A - A kind of data processing method, device, storage medium and server - Google Patents
A kind of data processing method, device, storage medium and server Download PDFInfo
- Publication number
- CN110245029A CN110245029A CN201910422643.8A CN201910422643A CN110245029A CN 110245029 A CN110245029 A CN 110245029A CN 201910422643 A CN201910422643 A CN 201910422643A CN 110245029 A CN110245029 A CN 110245029A
- Authority
- CN
- China
- Prior art keywords
- interface
- data processing
- data
- task
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 184
- 238000012545 processing Methods 0.000 claims abstract description 142
- 230000008569 process Effects 0.000 claims abstract description 110
- 238000004590 computer program Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 10
- 238000011161 development Methods 0.000 abstract description 9
- 238000003032 molecular docking Methods 0.000 abstract description 4
- 230000018109 developmental process Effects 0.000 description 8
- 238000013507 mapping Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000007613 environmental effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 241000208340 Araliaceae Species 0.000 description 4
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 4
- 235000003140 Panax quinquefolius Nutrition 0.000 description 4
- 235000008434 ginseng Nutrition 0.000 description 4
- 244000046052 Phaseolus vulgaris Species 0.000 description 3
- 235000010627 Phaseolus vulgaris Nutrition 0.000 description 3
- 238000002203 pretreatment Methods 0.000 description 3
- 230000033228 biological regulation Effects 0.000 description 2
- 239000000178 monomer Substances 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Abstract
The present invention provides a kind of data processing method, device, storage medium and servers, comprising: receives the interface for carrying configuration parameter that client is sent and calls task；It parses the interface and calls task, obtain the pending data and data process method corresponding with the configuration parameter in the interface calling task；According to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and determines the sequence of each data processing step；It determines that the corresponding data process method of each data processing step realizes class, and is sequentially generated process chain according to what the data process method realized class and the data processing step；Data processing is carried out to the pending data in the interface calling task based on the process chain.The unification that subsystem interface docking is called can be achieved in the present invention, reduces development difficulty, so that system can timely respond to call, improves the efficiency of interface calling.
Description
Technical field
The present invention relates to data processing field more particularly to a kind of data processing method, device, storage medium and services
Device.
Background technique
The essence of micro services is exactly to split application, the application system of a monomer framework has been split into independent one by one
Subsystem.Function same with monomer framework applications is realized between multiple subsystems in order to allow, it is inevitable between subsystem
Need mutual calling interface.When different subsystems carries out data/service interfacing, if it is subsystem and subsystem
Between directly docked, will lead to dependence between subsystem and become strong, the independence of each system is caused to be deteriorated, when wherein certain
When a subsystem has variation, another subsystem is often directly influenced.Especially carried out pair with one-to-many relationship
Situation is more obvious when connecing, and a subsystem may cover call method according to different subsystem developments more, such as uses
The required parameter of different-format parses the response message of different-format, can greatly increase development difficulty.
Summary of the invention
The embodiment of the invention provides a kind of data processing method, device, storage medium and servers, to solve existing skill
In art, a subsystem may cover call method according to different subsystem developments more, such as be joined using the request of different-format
Number, the problem of parsing the response message of different-format, development difficulty can be greatly increased.
The first aspect of the embodiment of the present invention provides a kind of data processing method, comprising:
It receives the interface for carrying configuration parameter that client is sent and calls task；
Parse the interface and call task, obtain pending data in the interface calling task and with the configuration
The corresponding data process method of parameter；
According to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and is determined
The sequence of each data processing step；
Determine that the corresponding data process method of each data processing step realizes class, and according to the data at
What reason logic realized class and the data processing step is sequentially generated process chain；
Data processing is carried out to the pending data in the interface calling task based on the process chain.
The second aspect of the embodiment of the present invention provides a kind of data processing equipment, comprising:
Calling task receiving unit, the interface for carrying configuration parameter for receiving client transmission call task；
Task resolution unit is called task for parsing the interface, is obtained to be processed in the interface calling task
Data and data process method corresponding with the configuration parameter；
Processing step determination unit, for being more by interface calling Task-decomposing according to the data process method
A data processing step, and determine the sequence of each data processing step；
Process chain generation unit, for determining that the corresponding data process method of each data processing step is realized
Class, and process chain is sequentially generated according to what the data process method realized class and the data processing step；
Data processing unit, for being counted based on the process chain to the pending data in the interface calling task
According to processing.
The third aspect of the embodiment of the present invention provides a kind of server, including memory and processor, the storage
Device is stored with the computer program that can be run on the processor, and the processor is realized such as when executing the computer program
Lower step:
It receives the interface for carrying configuration parameter that client is sent and calls task；
Parse the interface and call task, obtain pending data in the interface calling task and with the configuration
The corresponding data process method of parameter；
According to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and is determined
The sequence of each data processing step；
Determine that the corresponding data process method of each data processing step realizes class, and according to the data at
What reason logic realized class and the data processing step is sequentially generated process chain；
Data processing is carried out to the pending data in the interface calling task based on the process chain.
The fourth aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the computer program realizes following steps when being executed by processor:
It receives the interface for carrying configuration parameter that client is sent and calls task；
Parse the interface and call task, obtain pending data in the interface calling task and with the configuration
The corresponding data process method of parameter；
According to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and is determined
The sequence of each data processing step；
Determine that the corresponding data process method of each data processing step realizes class, and according to the data at
What reason logic realized class and the data processing step is sequentially generated process chain；
Data processing is carried out to the pending data in the interface calling task based on the process chain.
In the embodiment of the present invention, task, parsing are called by receiving the interface for carrying configuration parameter that client is sent
The interface calls task, obtains the pending data and number corresponding with the configuration parameter in the interface calling task
According to processing logic, then according to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing,
And determine the sequence of each data processing step, then determine the corresponding data processing of each data processing step
Logic realizes class, and is sequentially generated process chain, base according to what the data process method realized class and the data processing step
Data processing is carried out to the pending data in the interface calling task in the process chain.This programme can realize that subsystem connects
The unification that mouth docking is called, reduces development difficulty, so that system can timely respond to call, improves the efficiency of interface calling.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the implementation flow chart of data processing method provided in an embodiment of the present invention；
Fig. 2 is a kind of specific implementation flow chart of data processing method S105 provided in an embodiment of the present invention；
Fig. 3 is another specific implementation flow chart of data processing method S105 provided in an embodiment of the present invention；
Fig. 4 be another embodiment of the present invention provides data processing method implementation flow chart；
Fig. 5 is the structural block diagram of data processing equipment provided in an embodiment of the present invention；
Fig. 6 be another embodiment of the present invention provides data processing equipment structural block diagram；
Fig. 7 is the schematic diagram of server provided in an embodiment of the present invention.
Specific embodiment
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that disclosed below
Embodiment be only a part of the embodiment of the present invention, and not all embodiment.Based on the embodiments of the present invention, this field
Those of ordinary skill's all other embodiment obtained without making creative work, belongs to protection of the present invention
Range.
Fig. 1 shows the implementation process of data processing method provided in an embodiment of the present invention, and this method process includes step
S101 to S105.The specific implementation principle of each step is as follows:
S101: it receives the interface for carrying configuration parameter that client is sent and calls task.
In embodiments of the present invention, the configuration parameter is pre-set, to the interface of the subsystem under same system,
It is configured using preset parameter configuration rule.Specifically, the domain name for obtaining subsystem, the domain name according to the subsystem are true
The configuration of the fixed subsystem is to bean and goes out ginseng format, then obtains into parameter evidence, according to the configuration pair of the subsystem
Bean, go out ginseng format and it is described enter parameter evidence, be the subsystem interface carry out parameter configuration, obtain the subsystem
Configuration parameter, wherein it is described enter parameter according to according to business demand determine.Further, interface configuration parameter mapping table, institute are established
State the mapping relations of the interface identifier and configuration parameter in interface configuration parameter mapping table including subsystem.
Illustratively, when being adapted to the interface of new subsystem, it is necessary first to which then the domain name for configuring new subsystem is built
The bean of a vertical Rest Template and corresponding ginseng format out, enter ginseng by service definition, realize Result
Then Couvert interface configures a data in the database.When the interface call request that client is sent, parameter
It centainly needs to carry the data configured in this url_mapping, is then looked into forwardManager by this parameter
It askes corresponding interconnected system and goes out to join.
S102: parsing the interface and call task, obtain pending data in the interface calling task and with institute
State the corresponding data process method of configuration parameter.
Specifically, according to the interface call task carry configuration parameter and preset interface configuration parameter mapping table,
The interface identifier for the interface that determination need to call, according to the interface identifier, at the data for searching the corresponding subsystem of the interface
Manage logic.The data process method includes the steps that data processing and sequence.
Optionally, before carrying the interface calling task of configuration parameter described in the parsing, it is based on the interface tune
The configuration parameter carried with task, verifies the calling permission of the client, verifies whether the client has tune
Specifically the calling permission of client or the user using the client, building configuration permission are preset with the permission of interface
Table, the configuration authority list include the mapping relations of configuration parameter and client or the calling permission of user.The present invention is implemented
Example calls the client of task or the tune of user before calling task to parse the interface, to the interface is sent
It is verified with permission, so that the safety for calling data is effectively ensured.
S103: according to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and
Determine the sequence of each data processing step.
In embodiments of the present invention, according to the data process method, it is multiple numbers that the interface, which is called Task-decomposing,
According to processing step, and determine the sequence of each data processing step.Specifically, according to the data process method by institute
State interface call Task-decomposing be multiple data processing steps while, mark the suitable of each data processing step of decomposition
Sequence, and the data processing step is sorted by the sequence of label.
S104: determine that the corresponding data process method of each data processing step realizes class, and according to described
What data process method realized class and the data processing step is sequentially generated process chain.
Specifically, each data processing step is parsed, obtains the type of each data processing step
And method, further according to the type and method of the data processing step, respectively determining type with the data processing step and
The corresponding data process method of method realizes class.In embodiments of the present invention, the corresponding data of a data processing step
It handles logic and realizes class, a data process method realizes that class is packaged multiple data manipulation primitive, so that user
The mathematical logic that the corresponding subsystem of each data processing step provides need to only be understood and realize class, do not need to understand system bottom
The data manipulation primitive that frame provides, reduces development difficulty.
S105: data processing is carried out to the pending data in the interface calling task based on the process chain.
As an embodiment of the present invention, Fig. 2 shows data processing method S105's provided in an embodiment of the present invention
Specific implementation flow, details are as follows:
A1: calling preset data Processing Interface, and each data process method successively controlled in the process chain is real
Existing class inherits the preset data Processing Interface by the sequence of the data processing step, at the pending data
Reason.
A2: default input/output interface is called, each data process method described in the process chain is successively controlled
Realize that class receives a data process method and realizes the intermediate data that class obtains, first data processing is patrolled in the process chain
It collects and realizes that class receives the pending data.
In embodiments of the present invention, each number in the process chain according to the sequence notation of the data processing step
Realize that the order of succession of class successively controls each in the process chain by calling preset data Processing Interface according to processing logic
A data process method realizes that class inherits the preset data Processing Interface by the sequence of the data processing step, together
When, default input/output interface is called, realizes that the order of succession of class successively controls the processing according to the data process method
Each data process method described in chain realizes that class receives a data process method and realizes the intermediate data that class obtains, described
First data process method realizes that class receives the pending data.Specifically, the multiple data manipulations encapsulated in advance are called
Primitive handles the intermediate data, and obtained intermediate data is output to next data process method and realizes class,
Until obtaining final data processing result.
Illustratively, in embodiments of the present invention, preset data Processing Interface process, each data processing are provided
Logic realizes that class processor inherits preset data Processing Interface process, is the reality of preset data Processing Interface process
Example, for realizing the data handling procedure of corresponding data processing step.The last one data process method realizes class
Processor will not pass to intermediate data in next step, but the input/output interface that calling platform system provides, will be final
Data processed result is written in database or file.
It optionally, as an embodiment of the present invention, further include being joined according to the configuration before the step S105
Several regulations carries out unified pre-treatment to the environmental variance of the pending data and running environment.Specifically, being based on scalability
Consider, if necessary to the operation such as the pending data be initialized or pre-processed, and to the environmental variance of running environment
When being configured, related setting is carried out to configuration parameter, can avoid in each data processing step to the pending data
It the operation such as is initialized or is pre-processed again, realize lower coupling, keep all data processing steps pluggable, if the interface
The sequence of data processing step in calling task changes, it is only necessary to the sequence of data processing step is adjusted in configuration parameter
, improve the scalability of subsystem.
It optionally, as an embodiment of the present invention, further include being joined according to the configuration after the step S105
Several regulations carries out unified post-processing to the data processed result data after the data processing are completed, and by the operation ring
The environmental variance in border reverts to default conditions, to receive next excuse calling task.
It should be noted that in embodiments of the present invention, being carried out to the environmental variance of the pending data and running environment
The unified pre-treatment, described unified post-processed with to complete that the data processed result data after the data processing carry out
It is corresponding, for example, Data Format Transform, data screening etc..Further, when interface call task do not need to carry out initialization or
When pre-processing, or carrying out the operation such as configuring to the environmental variance of running environment, do not need to execute pre-treatment and post-processing operation.
As an embodiment of the present invention, as shown in figure 3, above-mentioned S105 further include:
B1: it if transmission interface calls the client more than one of task simultaneously, obtains and is asked in the interface calling task
Seek the target URL of calling.
B2: qualified call number of the target URL at the appointed time in section is searched.
B3: if sending the interface to call the number clients of task is more than the qualified call number, the visitor is obtained
The priority at family end.
B4: successively the pending data in the interface calling task is carried out at data by the priority of the client
Reason.
In embodiments of the present invention, when transmission interface calls the client more than one of task simultaneously, to request call
Target URL carry out current limliting, for example, some target URL only allows to call specified time per minute.Appoint if sending the interface and calling
The number clients of business are more than the qualified call number, then successively call task to the interface by the priority of the client
In pending data carry out data processing, avoid interface from calling conflict, to improve the efficiency of interface calling, and enhance use
Family experience.
In the embodiment of the present invention, task, parsing are called by receiving the interface for carrying configuration parameter that client is sent
The interface calls task, obtains the pending data and number corresponding with the configuration parameter in the interface calling task
According to processing logic, then according to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing,
And determine the sequence of each data processing step, then determine the corresponding data processing of each data processing step
Logic realizes class, and is sequentially generated process chain, base according to what the data process method realized class and the data processing step
Data processing is carried out to the pending data in the interface calling task in the process chain.This programme can realize that subsystem connects
The unification that mouth docking is called, reduces development difficulty, so that system can timely respond to call, improves the efficiency of interface calling.
Further, based on data processing method provided in above-mentioned Fig. 1 embodiment, another implementation of the invention is proposed
Example.In embodiments of the present invention, on the basis of step S101-S105 shown in Fig. 1, as shown in figure 4, the data processing side
Method further include:
S106: the IP address of the client is obtained.
S107: the interface type of the interface of request call in the interface calling task is determined according to the configuration parameter.
In embodiments of the present invention, the corresponding configuration parameter of the interface of different interface type exists different.It is connect according to parameter
The mouth table of comparisons determines the corresponding interface type of configuration parameter that the interface calls task to carry.
S108: the corresponding default current limliting table of comparisons of the interface type is determined.
In embodiments of the present invention, the interface type is corresponding with the default current limliting table of comparisons, according to the interface class
Type can determine the corresponding default current limliting table of comparisons of the interface type.
S109: being based on the default current limliting table of comparisons, search the corresponding default current limliting number of IP address of the client,
Task is called to carry out current limliting the interface that the client is sent.
In embodiments of the present invention, the default current limliting table of comparisons includes that IP address section is corresponding with default current limliting number
Relationship searches the corresponding default current limliting number of IP address of the client, to the visitor according to the default current limliting table of comparisons
The interface that family end is sent calls task to carry out current limliting.Such as: some IP only allows to request how many times per minute.
In the embodiment of the present invention, by obtaining the IP address of the client, institute is then determined according to the configuration parameter
The interface type for stating the interface of request call in interface calling task determines the corresponding default current limliting control of the interface type
Table, then it is based on the default current limliting table of comparisons, the corresponding default current limliting number of IP address of the client is searched, finally to institute
The interface for stating client transmission calls task to carry out current limliting, avoids client access excessively frequent, to guarantee the stabilization of access
Property.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Corresponding to data processing method described in foregoing embodiments, Fig. 5 is shown at data provided by the embodiments of the present application
The structural block diagram of reason device illustrates only part relevant to the embodiment of the present application for ease of description.
Referring to Fig. 5, which includes: calling task receiving unit 51, task resolution unit 52, processing step
Determination unit 53, process chain generation unit 54, data processing unit 55, in which:
Calling task receiving unit 51, the interface for carrying configuration parameter for receiving client transmission call task；
Task resolution unit 52 calls task for parsing the interface, obtain in the interface calling task wait locate
Manage data and data process method corresponding with the configuration parameter；
Processing step determination unit 53, for being by interface calling Task-decomposing according to the data process method
Multiple data processing steps, and determine the sequence of each data processing step；
Process chain generation unit 54, for determining that the corresponding data process method of each data processing step is real
Existing class, and process chain is sequentially generated according to what the data process method realized class and the data processing step；
Data processing unit 55, for being carried out based on the process chain to the pending data in the interface calling task
Data processing.
Optionally, the data processing unit 55 includes:
First data processing module successively controls each in the process chain for calling preset data Processing Interface
The data process method realizes that class inherits the preset data Processing Interface by the sequence of the data processing step, to described
Pending data is handled；
Second data processing module successively controls each described in the process chain for calling default input/output interface
A data process method realizes that class receives a data process method and realizes the intermediate data that class obtains, the process chain
In first data process method realize that class receives the pending data.
Optionally, the data processing unit 55 further include:
Target determination module connects described in acquisition if calling the client more than one of task for transmission interface simultaneously
The target URL of request call in mouth calling task；
Number searching module is limited the use of, for searching qualified call number of the target URL at the appointed time in section；
Priority Determination module, if calling the number clients of task for sending the interface is more than the qualified call
Number, then obtain the priority of the client；
Third data processing module, for the priority by the client successively in the interface calling task to
It handles data and carries out data processing.
Optionally, the data processing equipment further include:
Authorization check unit, the configuration parameter for calling task to carry based on the interface, to the tune of the client
It is verified with permission.
In the embodiment of the present invention, task, parsing are called by receiving the interface for carrying configuration parameter that client is sent
The interface calls task, obtains the pending data and number corresponding with the configuration parameter in the interface calling task
According to processing logic, then according to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing,
And determine the sequence of each data processing step, then determine the corresponding data processing of each data processing step
Logic realizes class, and is sequentially generated process chain, base according to what the data process method realized class and the data processing step
Data processing is carried out to the pending data in the interface calling task in the process chain.This programme can realize that subsystem connects
The unification that mouth docking is called, reduces development difficulty, so that system can timely respond to call, improves the efficiency of interface calling.
Optionally, as shown in fig. 6, the data processing equipment further include:
Address acquisition unit 61, for obtaining the IP address of the client；
Interface type determination unit 62, for determining request call in the interface calling task according to the configuration parameter
Interface interface type；
Table of comparisons searching unit 63, for determining the corresponding default current limliting table of comparisons of the interface type；
Calling task current limiting unit 64 searches the IP address of the client for being based on the default current limliting table of comparisons
Corresponding default current limliting number calls task to carry out current limliting the interface that the client is sent.
In the embodiment of the present invention, by obtaining the IP address of the client, institute is then determined according to the configuration parameter
The interface type for stating the interface of request call in interface calling task determines the corresponding default current limliting control of the interface type
Table, then it is based on the default current limliting table of comparisons, the corresponding default current limliting number of IP address of the client is searched, finally to institute
The interface for stating client transmission calls task to carry out current limliting, avoids client access excessively frequent, to guarantee the stabilization of access
Property.
Fig. 7 is the schematic diagram for the server that one embodiment of the invention provides.As shown in fig. 7, the server 7 of the embodiment wraps
It includes: processor 70, memory 71 and being stored in the computer that can be run in the memory 71 and on the processor 70
Program 72, such as data processor.The processor 70 is realized when executing the computer program 72 at above-mentioned each data
The step in embodiment of the method, such as step 101 shown in FIG. 1 are managed to 105.Alternatively, the processor 70 executes the calculating
The function of each module/unit in above-mentioned each Installation practice, such as the function of unit 51 to 55 shown in Fig. 5 are realized when machine program 72
Energy.
Illustratively, the computer program 72 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 71, and are executed by the processor 70, to complete the present invention.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 72 in the server 7 is described.
The server 7 can be desktop PC, notebook, palm PC and cloud server etc. and calculate equipment.
The server may include, but be not limited only to, processor 70, memory 71.It will be understood by those skilled in the art that Fig. 7 is only
It is the example of server 7, does not constitute the restriction to server 7, may include than illustrating more or fewer components or group
Close certain components or different components, for example, the server can also include input-output equipment, network access equipment,
Bus etc..
The processor 70 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 71 can be the internal storage unit of the server 7, such as the hard disk or memory of server 7.
The memory 71 is also possible to the External memory equipment of the server 7, such as the plug-in type being equipped on the server 7 is hard
Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card) etc..Further, the memory 71 can also both include the internal storage unit of the server 7 or wrap
Include External memory equipment.The memory 71 is for other programs needed for storing the computer program and the server
And data.The memory 71 can be also used for temporarily storing the data that has exported or will export.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as does not include electric carrier signal and electricity according to legislation and patent practice, computer-readable medium in certain jurisdictions
Believe signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality
Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of data processing method characterized by comprising
It receives the interface for carrying configuration parameter that client is sent and calls task；
Parse the interface and call task, obtain pending data in the interface calling task and with the configuration parameter
Corresponding data process method；
According to the data process method, it is multiple data processing steps that the interface, which is called Task-decomposing, and determination is each
The sequence of the data processing step；
It determines that the corresponding data process method of each data processing step realizes class, and is patrolled according to the data processing
That volume realizes class and the data processing step is sequentially generated process chain；
Data processing is carried out to the pending data in the interface calling task based on the process chain.
2. data processing method according to claim 1, which is characterized in that described to be based on the process chain to the interface
Pending data in calling task carries out data processing, further includes:
If transmission interface calls the client more than one of task simultaneously, request call in the interface calling task is obtained
Target URL；
Search qualified call number of the target URL at the appointed time in section；
If sending the interface and calling the number clients of task is more than the qualified call number, the excellent of the client is obtained
First grade；
Data processing successively is carried out to the pending data in the interface calling task by the priority of the client.
3. data processing method according to claim 1, which is characterized in that the data processing method further include:
Obtain the IP address of the client；
The interface type of the interface of request call in the interface calling task is determined according to the configuration parameter；
Determine the corresponding default current limliting table of comparisons of the interface type；
Based on the default current limliting table of comparisons, the corresponding default current limliting number of IP address of the client is searched, to the visitor
The interface that family end is sent calls task to carry out current limliting.
4. data processing method according to claim 1, which is characterized in that described to be based on the process chain to the interface
Pending data in calling task carries out data processing, comprising:
Preset data Processing Interface is called, each data process method successively controlled in the process chain realizes class by institute
The sequence for stating data processing step inherits the preset data Processing Interface, handles the pending data；
Default input/output interface is called, each data process method described in the process chain is successively controlled and realizes that class connects
It receives a data process method and realizes the intermediate data that class obtains, first data process method realizes class in the process chain
Receive the pending data.
5. data processing method according to claim 1, which is characterized in that the parsing interface call task it
Before, further includes:
Based on the configuration parameter that the interface calls task to carry, the calling permission of the client is verified.
6. a kind of data processing equipment, which is characterized in that the data processing equipment includes:
Calling task receiving unit, the interface for carrying configuration parameter for receiving client transmission call task；
Task resolution unit calls task for parsing the interface, obtains the pending data in the interface calling task
And data process method corresponding with the configuration parameter；
Processing step determination unit, for according to the data process method, it to be multiple numbers that the interface, which is called Task-decomposing,
According to processing step, and determine the sequence of each data processing step；
Process chain generation unit, for determining that the corresponding data process method of each data processing step realizes class,
And process chain is sequentially generated according to what the data process method realized class and the data processing step；
Data processing unit, for being carried out at data based on the process chain to the pending data in the interface calling task
Reason.
7. data processing equipment according to claim 6, which is characterized in that the data processing unit further include:
Target determination module obtains the interface tune if calling the client more than one of task for transmission interface simultaneously
With the target URL of request call in task；
Number searching module is limited the use of, for searching qualified call number of the target URL at the appointed time in section；
Priority Determination module, if calling the number clients of task for sending the interface is more than the qualified call number,
Then obtain the priority of the client；
Third data processing module, for the priority by the client successively to be processed in the interface calling task
Data carry out data processing.
8. data processing equipment according to claim 6, which is characterized in that the data processing equipment further include:
Address acquisition unit, for obtaining the IP address of the client；
Interface type determination unit, for determining the interface of request call in the interface calling task according to the configuration parameter
Interface type；
Table of comparisons searching unit, for determining the corresponding default current limliting table of comparisons of the interface type；
Calling task current limiting unit, for being based on the default current limliting table of comparisons, the IP address for searching the client is corresponding
Default current limliting number calls task to carry out current limliting the interface that the client is sent.
9. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In the step of realization data processing method as described in any one of claims 1 to 5 when the computer program is executed by processor
Suddenly.
10. a kind of server, including memory, processor and storage can transport in the memory and on the processor
Capable computer program, which is characterized in that the processor is realized when executing the computer program as in claim 1 to 5
The step of any one data processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910422643.8A CN110245029A (en) | 2019-05-21 | 2019-05-21 | A kind of data processing method, device, storage medium and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910422643.8A CN110245029A (en) | 2019-05-21 | 2019-05-21 | A kind of data processing method, device, storage medium and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110245029A true CN110245029A (en) | 2019-09-17 |
Family
ID=67884653
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910422643.8A Pending CN110245029A (en) | 2019-05-21 | 2019-05-21 | A kind of data processing method, device, storage medium and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110245029A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851209A (en) * | 2019-11-08 | 2020-02-28 | 北京字节跳动网络技术有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN112015769A (en) * | 2020-09-01 | 2020-12-01 | 平安付科技服务有限公司 | Data processing method and device, computer equipment and storage medium |
| CN112052105A (en) * | 2020-09-04 | 2020-12-08 | 京东数字科技控股股份有限公司 | Interface calling method and device, electronic equipment and computer readable medium |
| CN112214325A (en) * | 2020-10-20 | 2021-01-12 | 杭州电子科技大学 | FPGA task dynamic arrangement method, device, chip and storage medium |
| CN112579312A (en) * | 2019-09-30 | 2021-03-30 | 上海际链网络科技有限公司 | Parameter mapping method and device, storage medium, interface calling platform and service system |
| CN112597233A (en) * | 2020-12-29 | 2021-04-02 | 平安银行股份有限公司 | Batch processing method, device and equipment of data indexes and storage medium |
| CN113688175A (en) * | 2020-05-18 | 2021-11-23 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103701709A (en) * | 2013-12-13 | 2014-04-02 | 北京京东尚科信息技术有限公司 | Flow rate control method and system |
| CN105915621A (en) * | 2016-05-11 | 2016-08-31 | 深圳市永兴元科技有限公司 | Data access method and pretreatment server |
| CN106610837A (en) * | 2016-12-26 | 2017-05-03 | 中国建设银行股份有限公司 | Application development method and development platform |
| CN108845869A (en) * | 2018-05-31 | 2018-11-20 | 中国平安人寿保险股份有限公司 | Concurrent request control method, device, computer equipment and storage medium |
-
2019
- 2019-05-21 CN CN201910422643.8A patent/CN110245029A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103701709A (en) * | 2013-12-13 | 2014-04-02 | 北京京东尚科信息技术有限公司 | Flow rate control method and system |
| CN105915621A (en) * | 2016-05-11 | 2016-08-31 | 深圳市永兴元科技有限公司 | Data access method and pretreatment server |
| CN106610837A (en) * | 2016-12-26 | 2017-05-03 | 中国建设银行股份有限公司 | Application development method and development platform |
| CN108845869A (en) * | 2018-05-31 | 2018-11-20 | 中国平安人寿保险股份有限公司 | Concurrent request control method, device, computer equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112579312A (en) * | 2019-09-30 | 2021-03-30 | 上海际链网络科技有限公司 | Parameter mapping method and device, storage medium, interface calling platform and service system |
| CN110851209A (en) * | 2019-11-08 | 2020-02-28 | 北京字节跳动网络技术有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN113688175A (en) * | 2020-05-18 | 2021-11-23 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
| CN112015769A (en) * | 2020-09-01 | 2020-12-01 | 平安付科技服务有限公司 | Data processing method and device, computer equipment and storage medium |
| CN112052105A (en) * | 2020-09-04 | 2020-12-08 | 京东数字科技控股股份有限公司 | Interface calling method and device, electronic equipment and computer readable medium |
| CN112214325A (en) * | 2020-10-20 | 2021-01-12 | 杭州电子科技大学 | FPGA task dynamic arrangement method, device, chip and storage medium |
| CN112597233A (en) * | 2020-12-29 | 2021-04-02 | 平安银行股份有限公司 | Batch processing method, device and equipment of data indexes and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110245029A (en) | A kind of data processing method, device, storage medium and server | |
| US20230396669A1 (en) | Technologies for transparent function as a service arbitration for edge systems | |
| US8751620B2 (en) | Validating deployment patterns in a networked computing environment | |
| CN108696381B (en) | Protocol configuration method and device | |
| US11108871B2 (en) | Dynamic generation of network routing configuration with service requirements | |
| CN109150904A (en) | Interface service call method and terminal device | |
| CN109582452A (en) | A kind of container dispatching method, dispatching device and electronic equipment | |
| CN110058864A (en) | The dispositions method and device of micro services | |
| CN109343972A (en) | Task processing method and terminal device | |
| CN113361838A (en) | Business wind control method and device, electronic equipment and storage medium | |
| CN109685641A (en) | A kind of information processing method and device | |
| CN111159897B (en) | Target optimization method and device based on system modeling application | |
| WO2022267769A1 (en) | Method and apparatus for generating graph data | |
| CN109446648A (en) | Service of simulation method for building up and device | |
| CN108965404A (en) | Cloud net health services system and method | |
| CN105867928A (en) | Method and device for connecting designated calculation model to designated distributed system | |
| CN113626512A (en) | Data processing method, device, equipment and readable storage medium | |
| CN109299173A (en) | Data transmission method, device and storage medium | |
| CN106330556B (en) | A kind of method and apparatus calling related information for generating service module | |
| CN111045928A (en) | Interface data testing method, device, terminal and storage medium | |
| CN110175808A (en) | A kind of order management, querying method, device, equipment and medium | |
| CN115167985A (en) | Virtualized computing power providing method and system | |
| CN113590217B (en) | Function management method and device based on engine, electronic equipment and storage medium | |
| CN113110982B (en) | Data access layer verification method and device, storage medium and electronic device | |
| CN111400281B (en) | GIS data quality inspection and storage method for OSS object storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |