CN107193543A - A kind of batch operation performs method and device - Google Patents
A kind of batch operation performs method and device Download PDFInfo
- Publication number
- CN107193543A CN107193543A CN201710210787.8A CN201710210787A CN107193543A CN 107193543 A CN107193543 A CN 107193543A CN 201710210787 A CN201710210787 A CN 201710210787A CN 107193543 A CN107193543 A CN 107193543A
- Authority
- CN
- China
- Prior art keywords
- order
- performs
- information
- batch operation
- perform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/31—Programming languages or programming paradigms
- G06F8/313—Logic programming, e.g. PROLOG programming language
Abstract
Method and device is performed the embodiments of the invention provide a kind of batch operation.This method includes：Receive batch operation and perform order；Parse the batch operation and perform order, including：Execution machine set identification in order is performed according to the batch operation, determines that target performs machine；Every kind of param elements type information in order and the parameter sets mark of every kind of param elements are performed according to the batch operation, all target component elements to be operated are obtained；According to the batch operation perform in order on performing machine set, the operation relation between various parameters element set, determine that target performs the relation between machine and each target component element；Each target performs the relation between machine and target component element, the order example that one batch of correspondence is performed；Wherein, order example includes object run information；Concurrently perform each order example.Method is performed by batch operation provided in an embodiment of the present invention, it is possible to increase O＆M efficiency.
Description
Technical field
The present invention relates to Internet technical field, more particularly to a kind of batch operation performs method and device.
Background technology
In all kinds of IT (Information Technology, information technology) related work, order line batch is performed
Scene is very universal, and especially in the related work of O＆M, operation maintenance personnel is generally required to hundreds of machine node, number
Operated according to table, user or other resource objects.
In order to quickly finish work, people would generally by some operation and maintenance tools, such as ansible, puppet,
Fabric etc., these instruments can perform batch operation for host (main frame) list of definition, wherein, host lists are defined
A series of machine nodes, as perform machine, for example, it is assumed that be in each machine defined in host lists hostgroupA
The operation for accessing tables of data tableA is concurrently performed on node, ansible just can be utilized, pass through order line：ansible
HostgroupA-m shell-a " scan tableA " realize, wherein, hostgroupA can be regarded as the one of the order line
The parameter sets of individual host list types.
But these existing operation and maintenance tools can not typically be performed to the other types parameter sets in addition to host lists and criticized
In amount operation, such as above-mentioned example, tables of data is accessed to concurrently be performed on each machine node defined in hostgroupA
The operation of each tables of data in set Table1, just needs to be packaged the logic that the batch operation is performed, including
Defined parameters set, write some circulations and complete batch implementation procedure, while also to be realized in code to concurrently performing, performing
The control of order；And during later maintenance, when needing to perform the batch operation of similar logic, due to not general envelope
Dress, will carry out the exploitation largely repeated, in addition, extra information and execution logic are handled and implementation process in,
Generally easily there is bug (leak), it is necessary to debug repeatedly, cause O＆M efficiency low.
The content of the invention
The purpose of the embodiment of the present invention is that providing a kind of batch operation performs method and device, to improve O＆M efficiency.
Concrete technical scheme is as follows：
In a first aspect, performing method the embodiments of the invention provide a kind of batch operation, methods described includes：
Receive batch operation and perform order；Wherein, the batch operation performs order and at least included：Object run information,
Every kind of param elements type information, execution machine set identification, the parameter sets mark of every kind of param elements, and on performing machine collection
Operation relation between conjunction, various parameters element set；
Parse the batch operation and perform order, including：
Execution machine set identification in order is performed according to the batch operation, determines that target performs machine；
Every kind of param elements type information in order and the parameter of every kind of param elements are performed according to the batch operation
Set identification, obtains all target component elements to be operated；
The computing on performing between machine set, various parameters element set performed according to the batch operation in order is closed
System, determines that the target performs the relation between machine and each target component element；Each target performs machine and joined with target
Relation between number element, the order example that one batch of correspondence is performed；Wherein, the order example includes the object run
Information；
Concurrently perform each order example.
Alternatively, methods described also includes：Order is performed for each batch operation in advance, configuration file is generated；It is described
In configuration file, including：Every kind of param elements type information, execution machine set identification, the parameter set of every kind of param elements
Close mark, the corresponding param elements of every kind of param elements type or param elements routing information；
The execution machine set identification performed according to the batch operation in order, determines the step of target performs machine,
Including：
According to the corresponding execution machine of execution machine set identification in the configuration file, in batch operation execution order
Each in set performs machine, determines that target performs machine；
The every kind of param elements type information and every kind of param elements performed according to the batch operation in order
Parameter sets are identified, and obtain all target component elements to be operated, including：
Perform every kind of param elements in order for the batch operation, according to the type information of this kind of param elements and
Parameter sets are identified, and from the configuration file, obtain the corresponding target component element to be operated of this kind of param elements；Or according to
Type information and the parameter sets mark of this kind of param elements, determine the corresponding destination path of this kind of param elements, and based on institute
Destination path is stated, configuration management database CMDB is called, the corresponding target component element to be operated of this kind of param elements is obtained.
Alternatively, the batch operation performs the syntax rule that order meets jinjia template engines.
Alternatively, the batch operation performs order and is：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User gathers
Mark } } × { { Table set identifications } }
Wherein, first operation information is the object run information, and "=" is Nature Link operator, and "×" is flute
Karr accumulates operator.
Alternatively, the batch operation performs order and also included：Concurrently perform grouping information；
It is described the step of concurrently perform each order example, including：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Concurrently perform each order example set.
Alternatively, the batch operation performs order and is：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } ×
L.0%R.size, { { Region set identifications } } f=(R.0) { { Regionserver set identifications } }
Wherein, second operation information is the object run information；"×" is cartesian product operator；F is concurrent
Execution symbol, f and f position concurrently perform grouping information to be described, represent to be grouped with the relation after "×" computing concurrently to hold
OK；"=(L.0%R.size, R.0) " for equivalent concatenation operator, " % " is complementation operator, during R.size is right side set
Element number.
Alternatively, the batch operation performs order and also included：Concurrency information；
It is described the step of concurrently perform each order example, including：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Each order example set is concurrently performed, and for each order example set, the life is concurrently performed based on the concurrency information
Make the order example that example set is included.
Alternatively, the batch operation performs order and is：
Pexec " the 3rd operation information Error_ $ Pid/ default files folder name/$ User " the 3rd performs machine set identification |
Union (the 4th performs machine set identification) } } × { { Pid set identifications } } f* the 3rd User set identifications | func (L.n) }-
F presets concurrency
Wherein, the 3rd operation information is the object run information, and " union " accords with for duplicate removal union operation；“×”
For cartesian product operator；F is concurrently to perform symbol, and f and f position concurrently perform grouping information to be described, represent with "×"
Relation after computing is grouped concurrently to perform；" * " is represented the n-th row of element in relation on the left of " * " to bring extended arithmetic symbol into
Value is brought into after the filter function func (L.n) of right side user set respectively, and the element of each left side relation is brought into corresponding
Right side set element afterwards makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is big
In 0 natural number；"-f presets concurrency " is the concurrency execution information.
Second aspect, the embodiments of the invention provide a kind of batch operation performs device, described device includes：
Receiving module, order is performed for receiving batch operation；Wherein, the batch operation performs order and at least included：
Object run information, every kind of param elements type information, execution machine set identification, the parameter sets mark of every kind of param elements,
And on performing the operation relation between machine set, various parameters element set；
Parsing module, order is performed for parsing the batch operation, including；
First determination sub-module, for performing the execution machine set identification in order according to the batch operation, determines mesh
Mark execution machine；
Submodule is obtained, for performing every kind of param elements type information and every kind of in order according to the batch operation
The parameter sets mark of param elements, obtains all target component elements to be operated；
Second determination sub-module, for according to the batch operation perform order on perform machine set, each seed ginseng
Operation relation between number element set, determines that the target performs the relation between machine and each target component element；Each institute
State the relation between target execution machine and target component element, the order example that one batch of correspondence is performed；Wherein, the order
Example includes the object run information；
Performing module, for concurrently performing each order example.
Alternatively, described device also includes：
Generation module, for performing order for each batch operation in advance, generates configuration file；The configuration file
In, including：Every kind of param elements type information, execution machine set identification, the parameter sets of every kind of param elements are identified, often
Plant the corresponding param elements of parameter element type or param elements routing information；
First determination sub-module, specifically for：
According to the corresponding execution machine of execution machine set identification in the configuration file, in batch operation execution order
Each in set performs machine, determines that target performs machine；
The acquisition submodule, specifically for：
Perform every kind of param elements in order for the batch operation, according to the type information of this kind of param elements and
Parameter sets are identified, and from the configuration file, obtain the corresponding target component element to be operated of this kind of param elements；Or according to
Type information and the parameter sets mark of this kind of param elements, determine the corresponding destination path of this kind of param elements, and based on institute
Destination path is stated, configuration management database CMDB is called, the corresponding target component element to be operated of this kind of param elements is obtained.
Alternatively, the batch operation performs the syntax rule that order meets jinjia template engines.
Alternatively, the batch operation performs order and is：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User gathers
Mark } } × { { Table set identifications } }
Wherein, first operation information is the object run information, and "=" is Nature Link operator, and "×" is flute
Karr accumulates operator.
Alternatively, the batch operation performs order and also included：Concurrently perform grouping information；
The performing module, specifically for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Concurrently perform each order example set.
Alternatively, the batch operation performs order and is：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } ×
L.0%R.size, { { Region set identifications } } f=(R.0) { { Regionserver set identifications } }
Wherein, second operation information is the object run information；"×" is cartesian product operator；F is concurrent
Execution symbol, f and f position concurrently perform grouping information to be described, represent to be grouped with the relation after "×" computing concurrently to hold
OK；"=(L.0%R.size, R.0) " for equivalent concatenation operator, " % " is complementation operator, during R.size is right side set
Element number.
Alternatively, the batch operation performs order and also included：Concurrency information；
The performing module, specifically for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Each order example set is concurrently performed, and for each order example set, the life is concurrently performed based on the concurrency information
Make the order example that example set is included.
Alternatively, the batch operation performs order and is：
Pexec " the 3rd operation information Error_ $ Pid/ default files folder name/$ User " the 3rd performs machine set identification |
Union (the 4th performs machine set identification) } } × { { Pid set identifications } } f* the 3rd User set identifications | func (L.n) }-
F presets concurrency
Wherein, the 3rd operation information is the object run information, and " union " accords with for duplicate removal union operation；“×”
For cartesian product operator；F is concurrently to perform symbol, and f and f position concurrently perform grouping information to be described, represent with "×"
Relation after computing is grouped concurrently to perform；" * " is represented the n-th row of element in relation on the left of " * " to bring extended arithmetic symbol into
Value is brought into after the filter function func (L.n) of right side user set respectively, and the element of each left side relation is brought into corresponding
Right side set element afterwards makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is big
In 0 natural number；"-f presets concurrency " is the concurrency execution information.
A kind of batch operation provided in an embodiment of the present invention is performed in method and device method, can be received batch operation and be held
Line command；Then the execution machine set identification in order is performed according to the batch operation, determines that target performs machine；According to the batch
Operation performs every kind of param elements type information in order and the parameter sets mark of every kind of param elements, obtains to be operated
All target component elements；Further according to the batch operation perform order on perform machine set, various parameters element set
Between operation relation, determine that target performs the relation between machine and each target component element；Each target performs machine and target
Relation between param elements, the order example that one batch of correspondence is performed；Concurrently perform each order example.Wherein, this batch
Amount operation, which performs order, at least to be included：Object run information, every kind of param elements type information, perform machine set identification, it is every kind of
The parameter sets mark of param elements, and on performing the operation relation between machine set, various parameters element set；Order example
Include object run information；
As can be seen that method is performed using batch operation provided in an embodiment of the present invention, except host list type parameter sets
Close, that is, perform outside machine set, other kinds of param elements can also be directed to, according to execution machine set, various parameters element set
Operation relation between conjunction, performs order by the batch operation of reception and is parsed, the order example then obtained according to parsing is held
The related batch operation of row, without carrying out logical wrapper in advance, moreover, this programme has versatility, has both avoided weight
Multiple exploitation, prevents the generation of the bug in the implementation process of extra information and execution logic again, so as to improve O＆M effect
Rate.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 performs the schematic flow sheet of method for a kind of batch operation provided in an embodiment of the present invention；
Fig. 2 is a kind of structural representation of batch operation performs device provided in an embodiment of the present invention；
Fig. 3 is a kind of overall architecture schematic diagram of batch operation performs device provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
To improve O＆M efficiency, method and device is performed the embodiments of the invention provide a kind of batch operation.
A kind of batch operation provided first the embodiment of the present invention execution method is introduced below.
Shown in Figure 1, a kind of batch operation provided in an embodiment of the present invention performs method, including following several steps：
S101, receives batch operation and performs order.
In practical application, it is usually what is inputted by user that the batch operation of reception, which performs order,.
Wherein, batch operation performs order and at least included：Object run information, every kind of param elements type information, execution
The parameter sets mark of machine set identification, every kind of param elements, and on performing the fortune between machine set, various parameters element set
Calculation relation.
It should be noted that it is according to the pre-defined order line based on set relations computing that batch operation, which performs order,
What grammer was write, the wherein syntactic definition includes batch operation and performs command name, computing of nonidentity operation relation etc.,
Batch operation can be described to perform under scene, the relation of parameter sets element is expressed complicated batch operation, with after an action of the bowels
Continue according to the grammer, batch operation is correctly performed into command analysis into each order example.
For example, the exectorial entitled pexec of batch operation can be defined, naturally it is also possible to be that other are rational
Title；It is Nature Link operator of set etc. that "=", which can also be defined,.
It is understood that after batch operation execution order is received, can be according to the order line language pre-defined
Method, performs order to the batch operation and parses, obtain order example, specifically, including S102, S103 and S104, below
These three steps will be described in detail.
S102, the execution machine set identification in order is performed according to the batch operation, determines that target performs machine.
Wherein, to perform order to the batch operation of reception to parse, order first can be performed according to the batch operation
In execution machine set identification, determine target perform machine.
It is understood that batch operation performs one execution of each order example correspondence obtained by command analysis
Machine, and an execution machine can correspond to multiple order examples.Execution machine set identification can be one, or multiple,
This is not construed as limiting；Wherein, when it is one to perform machine set identification, target directly can be determined according to the execution machine set identification
Execution machine, and when it is multiple to perform machine set identification, target can finally be determined according to the operation relation performed between machine set
Execution machine.
For example, the batch operation is performed in order, and it is JY, SH, the corresponding execution machine collection of JY to perform machine set identification
Closing the execution machine included is respectively：jy1、jy2；The execution machine that the corresponding execution machine set of SH is included is：sh1；And between JY and SH
Operation relation be：JY | union (SH), i.e. cup, then, target performs machine and is just：Jy1, jy2 and sh1.
S103, every kind of param elements type information in order and the ginseng of every kind of param elements are performed according to the batch operation
Number set identification, obtains all target component elements to be operated.
It should be noted that for each param elements, can also be according to pre-defined screening grammer, to parameter set
The param elements included in conjunction are filtered again, to carry out batch operation execution for greater flexibility.
Specifically, param elements filtering can be carried out according to pre-defined relational calculus.For example, for form collection
Table1 is closed, the form for belonging to user user1 can be filtered out according to pre-defined Resource selection computing, specifically, can be with
For：Table1 | User=user1.
In a kind of specific implementation of the embodiment of the present invention, when the batch operation to be performed performs what is included in order
When parameter sets do not carry out related definition, order is performed receiving the batch operation, carries out before batch operation, also needs to these
Parameter sets are defined, specifically, and a kind of batch operation provided in an embodiment of the present invention performs method, can also include：
Order is performed for each batch operation in advance, configuration file is generated.
Wherein, in configuration file, it can include：Every kind of param elements type information, execution machine set identification, every kind of parameter
Parameter sets mark, the corresponding param elements of every kind of param elements type or the param elements routing information of element.
It should be noted that for any parameter sets, static set row can be defined directly in configuration file
Table, i.e., the param elements that the parameter sets are included, for example, the set identified for Table1, can be directly in configuration file
The collection is defined to be combined into：table[1:20]；The corresponding param elements path letter of the parameter sets can also be provided in configuration file
Breath, according to the param elements routing information, to define dynamic set list.
Correspondingly, S102, the execution machine set identification in order is performed according to the batch operation, determines that target performs machine,
It can include：
According in the corresponding execution machine set of execution machine set identification in configuration file, in batch operation execution order
Each perform machine, determine target perform machine.
Correspondingly, S103, the every kind of param elements type information and every kind of parameter in order are performed according to the batch operation
The parameter sets mark of element, obtains all target component elements to be operated, can include：
Every kind of param elements in order are performed for the batch operation, according to the type information and ginseng of this kind of param elements
Number set identification, from configuration file, obtains the corresponding target component element to be operated of this kind of param elements；Or according to the seed ginseng
The type information and parameter sets mark of number element, determine the corresponding destination path of this kind of param elements, and based on destination path,
Configuration management database CMDB is called, the corresponding target component element to be operated of this kind of param elements is obtained.
Wherein, CMDB (Configuration Management Database, configuration management database) to store with
The various configuration informations of equipment in enterprise IT architecture are managed, it is all closely linked to all service supports and service delivery process,
Support the operating of these flows, play the value of configuration information, while ensureing the accuracy of data dependent on related procedure.And this
The param elements being related in inventive embodiments are generally all the resource objects that business system is safeguarded, be therefore, it can by adaptation
CMDB defines dynamic set list.Specifically, due to CMDB it is typically many using RESTful (abbreviation REST,
Representational StateTransfer, declarative state transfer) API (Application Programming
Interface, application programming interface), in configuration file, different RESTful is called and is named as some parameter set
Close, and define the type of element, so that by the reading to parameter sets element, the request to CMDB is converted into, come needed for returning
Parameter list element.Wherein, RESTful API are the API design reasons of a set of internet application of current comparative maturity
By being prior art, here is omitted.
For example, it is assumed that Users param elements type includes two subclass：UserGroupA and UserGroupB,
Wherein it is possible to be based on path https://restfulapi/usersold, calls CMDB, and the restful is called is named as
UserGroupB, the list element of return is that UserGroupB gathers corresponding param elements, specifically, can be in configuration text
Made in part defined below：
[Users]
[UserGroupA]
[UserGroupB] cmdb=https://restfulapi/usersold
[UserGroupA]
Usera[1:100]
It is emphasized that in embodiments of the present invention, defined parameters set can also be carried out according to other reasonable manners,
It is not limited to upper type.
S104, according to the batch operation perform in order on performing machine set, the fortune between various parameters element set
Calculation relation, determines that target performs the relation between machine and each target component element；Each target performs machine and target component member
Relation between element, the order example that one batch of correspondence is performed.
Wherein it is possible to which based on pre-defined command-line syntax, the execution machine collection in order is performed according to the batch operation
The operation relation between operation relation, execution machine set and param elements set between conjunction and the fortune between various parameters element set
Calculation relation, is parsed, and determines that target performs the relation between machine and each target component element, each mesh determined
Mark the relation between execution machine and target component element, the order example that one batch of correspondence is performed.It is understood that each
Individual order example all includes corresponding object run information.For clarity, it will be subsequently introduced by specific embodiment, this
Place is repeated no more.
It should be noted that during being parsed to batch operation execution order, can also be according to actual need
Ask, go to obtain the essential information of each param elements, such as perform ip, the operating system version of machine, form or database are corresponding
Version information etc., the logic for realizing some condition judgments.
S105, concurrently performs each order example.
It should be noted that for each the order example parsed by S102 to S104, ssh can be passed through
The corresponding execution machine performance objective operation of (Secure Shell, safety shell protocol) Telnet.Wherein, it is suitable to ensure to order
Profit is performed, and can also perform the configuration that machine carries out the factor that the influence order such as performing environment variable is performed in advance for target.
In a kind of specific implementation of the embodiment of the present invention, it is contemplated that practicality, batch operation performs order can be with
It is to be write in the spread foundation of the syntax rule of jinja template engines, i.e., pre-defined is transported based on set relations
The command-line syntax of calculation can be the extension that the syntax rule based on jinja template engines is carried out.Correspondingly, the batch received
Operation performs the syntax rule that order meets jinjia template engines.It is prior art on jinjia template engines, herein not
Repeat again.
It is understood that several simple relational calculuses of the grammar rule definitions of jinja template engines, such as
List1 | union (list2) }, expression seeks union operation to relation list1 and list2；{{list1|intersect
(list2) computing that sought common ground to relation list1 and list2 } }, is represented；List1 | difference (list2) }, represent
Difference operation is asked to relation list1 and list2；List1 | a=b }, represent the computing that elected to relation list1.
It should be noted that scene is performed for the batch operation for flexibly compactly describing complexity, can also be in jinja templates
In the syntax rule of engine, extension adds following several relational calculuses：
{ { list1 } } × { { list2 } }, expression seeks cartesian product to list1 and list2；
{ { list1 } }={ { list2 } }, is Nature Link computing, and list2 is naturally connected on list1 by expression；
{ { list1 } }=(L.b, R.c) { { list2 } }, represents the c row of b column elements and list2 based on list1
Element, carries out equivalent concatenation operation by list1 and list2, specifically, how equivalence is connected as prior art, no longer goes to live in the household of one's in-laws on getting married herein
State；Wherein, b, c are the integer more than 0；
{ { list1 } } * list2 | func (L.n) }, bring extended arithmetic into, represent the n-th train value of element in list1
Bring into respectively after list2 filter function func (L.n), by list1 each element and the list2 elements after corresponding bring into
Make cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；For example, it is assumed that list1 is
{ A, B }, wherein, A=(d, e), B=(f, g) so, { { list1 } } * { { list2 | func (L.1) } } for A × list2 |
Func (d) } } with B × { { list2 | func (f) } union.
It is emphasized that in the embodiment of the present invention, relational calculus can the actual demand according to, be defined,
It is not limited to above-mentioned several.
Specifically, batch operation, which performs order, to be：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User gathers
Mark } } × { { Table set identifications } }
Wherein, pexec performs command name for pre-defined batch operation, certainly, and batch operation performs command name
Other rational titles can also be taken as, are not limited thereto；First operation information is object run information, and "=" connects for nature
Operator is connect, "×" is cartesian product operator.
For example, it is assumed that Operator identifies an execution machine set, including perform machine 10.121.1.4 and
10.121.1.87；UserGroupB identifies the parameter sets of a User type, including user userb1 and userb2；
Tables identifies the parameter sets of a Table type, wherein the table for belonging to user usera1 is table1 and table2.Such as
Fruit will on machine 10.121.1.4 and 10.121.1.87 is performed, respectively with userb1 and userb2 identity to table1 and
Table2 carries out random write test, and batch operation, which performs order, to be：
Pexec " test $ User $ Table " { { Operator } }={ { UserGroupB } } × and Tables | User=
usera1}}
Parsed for the specific instructions example, after determining that target performs machine and target component element, by certainly
Right concatenation operation obtains relation：(10.121.1.4, userb1), (10.121.1.87, userb2)；Cartesian product is asked to obtain again
Final relation：(10.121.1.4, userb1, table1), (10.121.1.4, userb1, table2),
(10.121.1.87, userb2, table1) and (10.121.1.87, userb2, table2), 4 relations of the above are corresponded to respectively
4 order examples when specific batch operation is performed：
ssh root@10.121.1.4“test userb1table1”
ssh root@10.121.1.4“test userb1table2”
ssh root@10.121.1.87“test userb2table1”
ssh root@10.121.1.87“test userb2table2”
Above-mentioned 4 order examples are concurrently performed, that is, are realized on machine 10.121.1.4 and 10.121.1.87 is performed, point
The batch operation of random write test is not carried out to table1 and table2 with userb1 and userb2 identity.Wherein, test is
Random write test command of the prior art, here is omitted.
As can be seen that user only need to be from actual demand, according to the pre-defined order based on set relations computing
Row grammer, inputs correct batch operation and performs order, just can easily realize corresponding batch operation.
In practical application, batch operation, which performs order, to be included：Concurrently perform grouping information；To realize packet simultaneously
Hair.
Correspondingly, S105, the step of concurrently performing each order example, can include：
According to grouping information is concurrently performed, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set.
For example, it is assumed that batch operation performs command analysis and obtains 10 order examples, it is grouped letter according to concurrently performing
This 10 order examples, can be divided into two order example sets by breath, i.e., perform the reality that the two order example sets are included simultaneously
Example.
Specifically, batch operation, which performs order, to be：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } ×
L.0%R.size, { { Region set identifications } } f=(R.0) { { Regionserver set identifications } }
Wherein, the second operation information is object run information；"×" is cartesian product operator；F is concurrently to perform symbol,
F and f position represents to be grouped with the relation after "×" computing concurrently to perform concurrently to perform grouping information；"=(is L.0%
R.size, R.0) " it is equivalent concatenation operator, " % " is complementation operator, and R.size is the element number during right side is gathered,
L.0 it is respectively and R.0 left side and right side set element sequence number, since 0, "=(L.0%R.size, R.0) " represents, first by a left side
Side set element sequence number makees complementation computing to right side set element number, by equivalent operation result and right side set element sequence number
Corresponding element makees Nature Link respectively, for example, left side set includes 4 elements, it is respectively (m1, m2, m3, m4), correspondence sequence number
For (0,1,2,3)；Right side set includes 2 elements, is respectively (p, q), correspondence serial number (0,1)；First respectively by left side sequence
Number gathering the element number that includes to right side carries out complementation, i.e., respectively by (0,1,2,3) to 2 complementations, obtain (0,1,0,1), then
The element of in operation result 0 corresponding left element and right side serial number 0 is made into a 1 corresponding left side in Nature Link, operation result
Side element and the element of right side serial number 1 make Nature Link, and obtaining final result is：(m1, p), (m2, q), (m3, p), (m4,
q)。
For example, it is assumed that JYOperator identifies an execution machine set, including an execution machine op；Regions
A partitioned set is identified, wherein table t1 subregion is：Regiona, regionb, regionc and regiond；
RegionServers identifies a partitioned server set, and the wherein corresponding partitioned servers of cluster b are rsa and rsb.Such as
Fruit will concurrently perform the order that table t1 subregion is distributed to cluster c1, then batch operation performs order on machine op is performed
Can be：
Pexec " move $ Region $ RegionServer " { { JYOperator } } × and Regions | Table=t1 } f
=(L.0%R.size, R.0) RegionServers | Cluster=c1 }
Parsed for the specific instructions example, after determining that target performs machine and target component element, seek flute card
You obtain relation at product：(op, regiona), (op, regionb), (op, regionc), (op, regiond)；Connect again by equivalent
Computing is connect, final relation is obtained：(op, regiona, rsa), (op, regionb, rsb), (op, regionc, rsa), (op,
Regiond, rsb), 4 relations of the above are respectively 4 order examples when specific batch operation is performed：
ssh root@op“move regiona rsa”
ssh root@op“move regionb rsb”
ssh root@op“move regionc rsa”
ssh root@op“move regiond rsb”
Wherein, f represents to be grouped with the relation after "×" computing concurrently to perform after relational operator "×", i.e., concurrent
4 order examples more than performing, in this way, just can realize on machine op is performed, concurrently perform table t1 subregion being distributed to collection
Group c1 batch operation.Wherein, move is movement directive of the prior art, and here is omitted.
Further, batch operation performs order and can also included：Concurrency information, it is concurrent in each packet to describe
Implementation status.
Correspondingly, the step of concurrently performing each order example, can include：
According to grouping information is concurrently performed, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set, and for each order example set, the order example set is concurrently performed based on concurrency information
Comprising order example.
It is the complications for more clearly describing batch operation in a kind of specific implementation of the embodiment of the present invention, also
Can be according to the corresponding available resources of each order example set, such as thread, using concurrency information, to set each order
Number of concurrent in example set, to prevent because the order example included in each order example set is excessive, and largely takes resource,
So as to influence the phenomenon of other business to occur.
Specifically, batch operation, which performs order, to be：
Pexec " the 3rd operation information Error_ $ Pid/ default files folder name/$ User " the 3rd performs machine set identification |
Union (the 4th performs machine set identification) } } × { { Pid set identifications } } f* the 3rd User set identifications | func (L.n) }-
F presets concurrency
Wherein, the 3rd operation information is object run information, and " union " accords with for duplicate removal union operation；"×" is Descartes
Product operator；F is concurrently to perform symbol, and f and f position are represented with the relation after "×" computing concurrently to perform grouping information
It is grouped concurrently to perform；" * " represents to bring the n-th train value of element in relation on the left of " * " into the right side respectively to bring extended arithmetic symbol into
After the filter function func (L.n) of side user set, the element of each left side relation is gathered with the right side after corresponding bring into
Element makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is the natural number more than 0；
"-f presets concurrency " is concurrency execution information.
For example, it is assumed that ServicePid identifies a process collection, wherein belonging to visitor v1 process identification (PID) point
Not：pid_01；Users identifies the parameter sets of a User type；JY identifies an execution machine set, including performs
Machine：Jy1 and jy2；SH identifies another and performs machine set, including performs machine：sh1.If what is identified in JY and SH is all
On execution machine, lookup is present under User Catalog, some visitor v1 error procedure daily record, and sets concurrency as 10, then batch
Amount operation performs order：
pexec"grep–r Error_$Pid/home/$User"{{JY|union(SH)}}×{{ServicePid|
Guest=v1 } } f* Users | and Host=L.1 }-f 10
Parsed for the specific instructions example, after determining that target performs machine and target component element, Ran Houqiu
Cartesian product obtains relation：(jy1, pid_01), (jy2, pid_01), (sh1, pid_01)；It is false again by bringing extended arithmetic into
If obtained final relation is：(jy1, pid_01, user1), (jy1, pid_01, user2), (jy2, pid_01, user1),
(jy2, pid_01, user1), (sh1, pid_01, user1), (sh2, pid_01, user2), 6 relations and f more than
Position, obtains 6 order examples：
Order example set 1：
ssh root@jy1“grep–r Error_pid_01/home/user1”
ssh root@jy1“grep–r Error_pid_01/home/user2”
Order example set 2：
ssh root@jy2“grep–r Error_pid_01/home/user1”
ssh root@jy2“grep–r Error_pid_01/home/user2”
Order example set 3：
ssh root@sh1“grep–r Error_pid_01/home/user1”
ssh root@sh1“grep–r Error_pid_01/home/user2”
According to above-mentioned packet, each example set is performed side by side, on all execution machines that just may be implemented in JY and SH marks, is looked into
Look for and existing under User Catalog, the batch operation of some visitor v1 error procedure daily record.
In practical application, if to collect in cluster c2, the daily record of some services is named to specific node, then batch
Amount operation performs order：
pexec"scp/data/${Service}.log${Host}:/tmp/${Host}-${Service}.log"
{ { JY } } * Services | and Host=L.1 } f × { { LogHost [1] } } * { L.3 } * { L.2 }-f 100
Wherein, JY identifies an execution machine set, is the node in cluster c2；Service identifies a services set
Close；LogHost defines a Host type parameter element set.
Parsed for the specific instructions example, it is first determined target performs machine, it is assumed that be：Node1 and node2；So
Bring extended arithmetic into afterwards, it is assumed that obtain relation：(node1, DN), (node1, RS), (node2, DN), (node2, RS)；It is false
If LogHost [1] is loghost, then asks after cartesian product, obtains relation：(node1, DN, loghost), (node1, RS,
Loghost), (node2, DN, loghost), (node2, RS, loghost)；Again by once bringing extended arithmetic into, closed
System：(node1, DN, loghost, loghost), (node1, RS, loghost, loghost), (node2, DN, loghost,
Loghost), (node2, RS, loghost, loghost)；Eventually pass and once bring into after extended arithmetic, obtain final relation：
(node1, DN, loghost, loghost, DN), (node1, RS, loghost, loghost, RS), (node2, DN,
Loghost, loghost, DN), (node2, RS, loghost, loghost, RS), 4 relations and f position, are obtained more than
To 4 order examples：
Order example set A
ssh root@node1“scp/data/DN.log loghost:/tmp/loghost-DN.log”
ssh root@node1“scp/data/RS.log loghost:/tmp/loghost-RS.log”
Order example set B
ssh root@node2“scp/data/DN.log loghost:/tmp/loghost-DN.log”
ssh root@node2“scp/data/RS.log loghost:/tmp/loghost-RS.log”
According to above-mentioned packet, each example set is performed side by side, just can be realized in collection cluster c2, the daily record of some services is arrived
Specific node, and the batch operation named.Wherein, scp is the order that the telefile copy for carrying out safety is logged in based on ssh,
For prior art, here is omitted.
As can be seen that the batch operation that inventive embodiments shown in application drawing 1 are provided performs method, except host list types ginseng
Manifold is closed, that is, is performed outside machine set, can also be directed to other kinds of param elements, according to execution machine set, various parameters member
Operation relation between element set, performs order by the batch operation of reception and is parsed, the order reality then obtained according to parsing
Example, performs related batch operation, without carrying out logical wrapper in advance, moreover, this programme has versatility, both avoided
Overlapping development, prevents the generation of the bug in the implementation process of extra information and execution logic, so as to improve O＆M again
Efficiency.
It is corresponding with above method flow, the embodiments of the invention provide a kind of batch operation performs device, such as Fig. 2 institutes
Show, described device includes：
Receiving module 201, order is performed for receiving batch operation；Wherein, the batch operation performs order and at least wrapped
Include：Object run information, every kind of param elements type information, execution machine set identification, the parameter sets mark of every kind of param elements
Know, and on performing the operation relation between machine set, various parameters element set；
Parsing module 202, order is performed for parsing the batch operation, including：
First determination sub-module 2021, for performing the execution machine set identification in order according to the batch operation, really
Set the goal execution machine；
Obtain submodule 2022, for according to the batch operation perform order in every kind of param elements type information and
The parameter sets mark of every kind of param elements, obtains all target component elements to be operated；
Second determination sub-module 2023, for according to the batch operation perform in order on performing machine set, it is each
The operation relation between parameter element set is planted, determines that the target performs the relation between machine and each target component element；Often
The individual target performs the relation between machine and target component element, the order example that one batch of correspondence is performed；Wherein, it is described
Order example includes the object run information；
Performing module 203, for concurrently performing each order example.
The batch operation performs device that inventive embodiments shown in application drawing 2 are provided, except host list type parameter sets, i.e.,
Outside execution machine set, other kinds of param elements can also be directed to, according between execution machine set, various parameters element set
Operation relation, performs order by the batch operation of reception and is parsed, the order example then obtained according to parsing performs correlation
Batch operation, without carrying out logical wrapper in advance, moreover, this programme has versatility, both avoid overlapping development,
The generation of the bug in the implementation process of extra information and execution logic is prevented again, so as to improve O＆M efficiency.
Alternatively, described device can also include：
Generation module (not shown), for performing order for each batch operation in advance, generates configuration file；Institute
State in configuration file, including：Every kind of param elements type information, execution machine set identification, the parameter of every kind of param elements
Set identification, the corresponding param elements of every kind of param elements type or param elements routing information；
First determination sub-module 2021, specifically can be used for：
According to the corresponding execution machine of execution machine set identification in the configuration file, in batch operation execution order
Each in set performs machine, determines that target performs machine；
The acquisition submodule 2022, specifically can be used for：
Perform every kind of param elements in order for the batch operation, according to the type information of this kind of param elements and
Parameter sets are identified, and from the configuration file, obtain the corresponding target component element to be operated of this kind of param elements；Or according to
Type information and the parameter sets mark of this kind of param elements, determine the corresponding destination path of this kind of param elements, and based on institute
Destination path is stated, configuration management database CMDB is called, the corresponding target component element to be operated of this kind of param elements is obtained.
It should be noted that in a kind of specific implementation of the embodiment of the present invention, the one of batch operation performs device
Kind of overall architecture schematic diagram can with as shown in figure 3, including：Command line interface, correspondence receiving module 201；Gather definer, correspondence
Generation module；Command interpreter, correspondence parsing module 202；Command executer, correspondence performing module 203.Wherein, order line connects
Mouthful, order is performed for receiving batch operation, then, by command interpreter to parse batch operation performs order, order is obtained
Example；In resolving, command interpreter can obtain parameters set, more specifically as needed from set definer
Ground, is directly obtained from configuration file, or calls CMDB to obtain；It is last that machine is performed by command executer telnet, perform each
The corresponding operation of individual example；Wherein, set definer is used for the definition that relevant parameter set is carried out in configuration file.Certainly,
One specific example of batch operation performs device shown in Fig. 3, the only embodiment of the present invention, without restriction effect.
Alternatively, the batch operation performs the syntax rule that order meets jinjia template engines.
Alternatively, the batch operation, which performs order, to be：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User gathers
Mark } } × { { Table set identifications } }
Wherein, first operation information is the object run information, and "=" is Nature Link operator, and "×" is flute
Karr accumulates operator.
Alternatively, the batch operation performs order and can also included：Concurrently perform grouping information；
The performing module 203, specifically can be used for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Concurrently perform each order example set.
Alternatively, the batch operation, which performs order, to be：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } ×
L.0%R.size, { { Region set identifications } } f=(R.0) { { Regionserver set identifications } }
Wherein, second operation information is the object run information；"×" is cartesian product operator；F is concurrent
Execution symbol, f and f position concurrently perform grouping information to be described, represent to be grouped with the relation after "×" computing concurrently to hold
OK；"=(L.0%R.size, R.0) " for equivalent concatenation operator, " % " is complementation operator, during R.size is right side set
Element number.
Alternatively, the batch operation performs order and can also included：Concurrency information；
The performing module 203, specifically can be used for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example is obtained
Group；Each order example set is concurrently performed, and for each order example set, the life is concurrently performed based on the concurrency information
Make the order example that example set is included.
Alternatively, the batch operation, which performs order, to be：
Pexec " the 3rd operation information Error_ $ Pid/home/ $ User " the 3rd performs machine set identification | union (the
Four perform machine set identifications) } } × { { Pid set identifications } } f* { { the 3rd User set identifications | func (L.n) } }-f is default simultaneously
Hair degree
Wherein, the 3rd operation information is the object run information, and " union " accords with for duplicate removal union operation；“×”
For cartesian product operator；F is concurrently to perform symbol, and f and f position concurrently perform grouping information to be described, represent with "×"
Relation after computing is grouped concurrently to perform；" * " is represented the n-th row of element in relation on the left of " * " to bring extended arithmetic symbol into
Value is brought into after the filter function func (L.n) of right side user set respectively, and the element of each left side relation is brought into corresponding
Right side set element afterwards makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is big
In 0 natural number；"-f presets concurrency " is the concurrency execution information.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or deposited between operating
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Nonexcludability is included, so that process, method, article or equipment including a series of key elements not only will including those
Element, but also other key elements including being not expressly set out, or also include being this process, method, article or equipment
Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that
Also there is other identical element in process, method, article or equipment including the key element.
Each embodiment in this specification is described by the way of related, identical similar portion between each embodiment
Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.It is real especially for system
Apply for example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention
It is interior.
Claims (16)
1. a kind of batch operation performs method, it is characterised in that methods described includes：
Receive batch operation and perform order；Wherein, the batch operation performs order and at least included：It is object run information, every kind of
Param elements type information, perform machine set identification, the parameter sets mark of every kind of param elements, and on perform machine set,
Operation relation between various parameters element set；
Parse the batch operation and perform order, including：
Execution machine set identification in order is performed according to the batch operation, determines that target performs machine；
Every kind of param elements type information in order and the parameter sets of every kind of param elements are performed according to the batch operation
Mark, obtains all target component elements to be operated；
According to the batch operation perform in order on performing machine set, the operation relation between various parameters element set,
Determine that the target performs the relation between machine and each target component element；Each target performs machine and target component member
Relation between element, the order example that one batch of correspondence is performed；Wherein, the order example is believed comprising the object run
Breath；
Concurrently perform each order example.
2. according to the method described in claim 1, it is characterised in that methods described also includes：Each batch operation is directed in advance
Order is performed, configuration file is generated；In the configuration file, including：Every kind of param elements type information, execution machine set
Mark, the parameter sets of every kind of param elements mark, the corresponding param elements of every kind of param elements type or param elements path
Information；
The execution machine set identification performed according to the batch operation in order, determines the step of target performs machine, including：
According to the corresponding execution machine set of execution machine set identification in the configuration file, in batch operation execution order
In each perform machine, determine target perform machine；
It is described that every kind of param elements type information in order and the parameter of every kind of param elements are performed according to the batch operation
Set identification, obtains all target component elements to be operated, including：
Every kind of param elements in order are performed for the batch operation, according to the type information and parameter of this kind of param elements
Set identification, from the configuration file, obtains the corresponding target component element to be operated of this kind of param elements；Or according to this kind
Type information and the parameter sets mark of param elements, determine the corresponding destination path of this kind of param elements, and based on the mesh
Path is marked, configuration management database CMDB is called, obtains the corresponding target component element to be operated of this kind of param elements.
3. according to the method described in claim 1, it is characterised in that the batch operation execution order meets jinjia templates and drawn
The syntax rule held up.
4. method according to claim 3, it is characterised in that the batch operation performs order and is：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User set marks
Know } × { { Table set identifications } }
Wherein, first operation information is the object run information, and "=" is Nature Link operator, and "×" is Descartes
Product operator.
5. method according to claim 3, it is characterised in that the batch operation, which performs order, also to be included：Concurrently perform
Grouping information；
It is described the step of concurrently perform each order example, including：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set.
6. method according to claim 5, it is characterised in that the batch operation performs order and is：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } × { { Region collection
Close mark } } L.0%R.size, f=(R.0) { { Regionserver set identifications } }
Wherein, second operation information is the object run information；"×" is cartesian product operator；F is concurrently to perform
Symbol, f and f position concurrently perform grouping information to be described, represent to be grouped with the relation after "×" computing concurrently to perform；
"=(L.0%R.size, R.0) " for equivalent concatenation operator, " % " is complementation operator, and R.size is the member during right side is gathered
Plain number.
7. method according to claim 3, it is characterised in that the batch operation, which performs order, also to be included：Concurrency is believed
Breath；
It is described the step of concurrently perform each order example, including：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set, and for each order example set, concurrently performs the order based on the concurrency information real
The order example that example group is included.
8. method according to claim 7, it is characterised in that the batch operation performs order and is：
Pexec " the 3rd operation information Error_ $ Pid/ default files folder name/$ User " the 3rd performs machine set identification |
Union (the 4th performs machine set identification) } } × { { Pid set identifications } } f* the 3rd User set identifications | func (L.n) }-
F presets concurrency
Wherein, the 3rd operation information is the object run information, and " union " accords with for duplicate removal union operation；"×" is flute
Karr accumulates operator；F is concurrently to perform symbol, and f and f position concurrently perform grouping information to be described, represent with "×" computing
Relation afterwards is grouped concurrently to perform；" * " is represented the n-th train value point of element in relation on the left of " * " to bring extended arithmetic symbol into
Do not bring into right side user set filter function func (L.n) after, by the element of each left side relation with after corresponding bring into
Right side set element makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is more than 0
Natural number；"-f presets concurrency " is the concurrency execution information.
9. a kind of batch operation performs device, it is characterised in that described device includes：
Receiving module, order is performed for receiving batch operation；Wherein, the batch operation performs order and at least included：Target
Operation information, every kind of param elements type information, execution machine set identification, the parameter sets mark of every kind of param elements, and close
Operation relation between execution machine set, various parameters element set；
Parsing module, order is performed for parsing the batch operation, including：
First determination sub-module, for performing the execution machine set identification in order according to the batch operation, determines that target is held
Row machine；
Submodule is obtained, for performing every kind of param elements type information and every kind of parameter in order according to the batch operation
The parameter sets mark of element, obtains all target component elements to be operated；
Second determination sub-module, it is first on execution machine set, various parameters in order for being performed according to the batch operation
Operation relation between element set, determines that the target performs the relation between machine and each target component element；Each mesh
Mark the relation between execution machine and target component element, the order example that one batch of correspondence is performed；Wherein, the order example
Include the object run information；
Performing module, for concurrently performing each order example.
10. device according to claim 9, it is characterised in that described device also includes：
Generation module, for performing order for each batch operation in advance, generates configuration file；In the configuration file, bag
Include：Every kind of param elements type information, execution machine set identification, the parameter sets mark of every kind of param elements, every seed ginseng
The corresponding param elements of number element type or param elements routing information；
First determination sub-module, specifically for：
According to the corresponding execution machine set of execution machine set identification in the configuration file, in batch operation execution order
In each perform machine, determine target perform machine；
The acquisition submodule, specifically for：
Every kind of param elements in order are performed for the batch operation, according to the type information and parameter of this kind of param elements
Set identification, from the configuration file, obtains the corresponding target component element to be operated of this kind of param elements；Or according to this kind
Type information and the parameter sets mark of param elements, determine the corresponding destination path of this kind of param elements, and based on the mesh
Path is marked, configuration management database CMDB is called, obtains the corresponding target component element to be operated of this kind of param elements.
11. device according to claim 9, it is characterised in that the batch operation performs order and meets jinjia templates
The syntax rule of engine.
12. device according to claim 11, it is characterised in that the batch operation performs order and is：
Pexec " the first operation information User Table " { { first performs machine set identification } }={ { the first User set marks
Know } × { { Table set identifications } }
Wherein, first operation information is the object run information, and "=" is Nature Link operator, and "×" is Descartes
Product operator.
13. device according to claim 11, it is characterised in that the batch operation, which performs order, also to be included：Concurrently hold
Row grouping information；
The performing module, specifically for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set.
14. device according to claim 13, it is characterised in that the batch operation performs order and is：
Pexec " the second operation information $ Region $ RegionServer " { { second performs machine set identification } } × { { Region collection
Close mark } } L.0%R.size, f=(R.0) { { Regionserver set identifications } }
Wherein, second operation information is the object run information；"×" is cartesian product operator；F is concurrently to perform
Symbol, f and f position concurrently perform grouping information to be described, represent to be grouped with the relation after "×" computing concurrently to perform；
"=(L.0%R.size, R.0) " for equivalent concatenation operator, " % " is complementation operator, and R.size is the member during right side is gathered
Plain number.
15. device according to claim 11, it is characterised in that the batch operation, which performs order, also to be included：Concurrency
Information；
The performing module, specifically for：
Grouping information is concurrently performed according to described, each order example is grouped, at least one order example set is obtained；And
Hair performs each order example set, and for each order example set, concurrently performs the order based on the concurrency information real
The order example that example group is included.
16. device according to claim 15, it is characterised in that the batch operation performs order and is：
Pexec " the 3rd operation information Error_ $ Pid/ default files folder name/$ User " the 3rd performs machine set identification |
Union (the 4th performs machine set identification) } } × { { Pid set identifications } } f* the 3rd User set identifications | func (L.n) }-
F presets concurrency
Wherein, the 3rd operation information is the object run information, and " union " accords with for duplicate removal union operation；"×" is flute
Karr accumulates operator；F is concurrently to perform symbol, and f and f position concurrently perform grouping information to be described, represent with "×" computing
Relation afterwards is grouped concurrently to perform；" * " is represented the n-th train value point of element in relation on the left of " * " to bring extended arithmetic symbol into
Do not bring into right side user set filter function func (L.n) after, by the element of each left side relation with after corresponding bring into
Right side set element makees cartesian product computing, then each after cartesian product computing is collected into cooperation union operation；N is more than 0
Natural number；"-f presets concurrency " is the concurrency execution information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710210787.8A CN107193543B (en) | 2017-03-31 | 2017-03-31 | Batch operation execution method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710210787.8A CN107193543B (en) | 2017-03-31 | 2017-03-31 | Batch operation execution method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107193543A true CN107193543A (en) | 2017-09-22 |
| CN107193543B CN107193543B (en) | 2020-05-22 |
Family
ID=59871384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710210787.8A Active CN107193543B (en) | 2017-03-31 | 2017-03-31 | Batch operation execution method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107193543B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109120453A (en) * | 2018-08-31 | 2019-01-01 | 上海新炬网络信息技术股份有限公司 | A kind of overall situation shows the method for IT infrastructure data in CMDB |
| CN110412953A (en) * | 2019-07-03 | 2019-11-05 | 北京云迹科技有限公司 | Industrial personal computer bulk management method and system |
| CN112882752A (en) * | 2021-01-26 | 2021-06-01 | 苏州达家迎信息技术有限公司 | Method and device for batch processing of microservices, computer equipment and storage medium |
| CN113094185A (en) * | 2021-04-13 | 2021-07-09 | 中国工商银行股份有限公司 | Method and device for detecting parallel data processing abnormity of database batch program |
| CN114553660A (en) * | 2022-01-10 | 2022-05-27 | 北京思特奇信息技术股份有限公司 | Distributed system and operation and maintenance method for efficient operation and maintenance |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5504888A (en) * | 1992-10-23 | 1996-04-02 | Hitachi, Ltd. | File updating system employing the temporary connection and disconnection of buffer storage to extended storage |
| US20070083708A1 (en) * | 2005-10-07 | 2007-04-12 | William Zhou | Controller of redundant arrays of independent disks and operation method thereof |
| US20080201290A1 (en) * | 2007-02-16 | 2008-08-21 | International Business Machines Corporation | Computer-implemented methods, systems, and computer program products for enhanced batch mode processing of a relational database |
| US20130111486A1 (en) * | 2011-11-01 | 2013-05-02 | Fujitsu Limited | Apparatus and method for exclusive control |
| CN103646111A (en) * | 2013-12-25 | 2014-03-19 | 普元信息技术股份有限公司 | System and method for realizing real-time data association in big data environment |
| CN105426238A (en) * | 2016-01-17 | 2016-03-23 | 浙江维融电子科技股份有限公司 | Control method of equipment background instruction management system based on memory |
| CN105808418A (en) * | 2014-12-29 | 2016-07-27 | 平安科技（深圳）有限公司 | Test machine registration method, device and system |
-
2017
- 2017-03-31 CN CN201710210787.8A patent/CN107193543B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5504888A (en) * | 1992-10-23 | 1996-04-02 | Hitachi, Ltd. | File updating system employing the temporary connection and disconnection of buffer storage to extended storage |
| US20070083708A1 (en) * | 2005-10-07 | 2007-04-12 | William Zhou | Controller of redundant arrays of independent disks and operation method thereof |
| US20080201290A1 (en) * | 2007-02-16 | 2008-08-21 | International Business Machines Corporation | Computer-implemented methods, systems, and computer program products for enhanced batch mode processing of a relational database |
| US20130111486A1 (en) * | 2011-11-01 | 2013-05-02 | Fujitsu Limited | Apparatus and method for exclusive control |
| CN103646111A (en) * | 2013-12-25 | 2014-03-19 | 普元信息技术股份有限公司 | System and method for realizing real-time data association in big data environment |
| CN105808418A (en) * | 2014-12-29 | 2016-07-27 | 平安科技（深圳）有限公司 | Test machine registration method, device and system |
| CN105426238A (en) * | 2016-01-17 | 2016-03-23 | 浙江维融电子科技股份有限公司 | Control method of equipment background instruction management system based on memory |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109120453A (en) * | 2018-08-31 | 2019-01-01 | 上海新炬网络信息技术股份有限公司 | A kind of overall situation shows the method for IT infrastructure data in CMDB |
| CN109120453B (en) * | 2018-08-31 | 2021-04-23 | 上海新炬网络信息技术股份有限公司 | Method for globally showing IT basic architecture data in CMDB |
| CN110412953A (en) * | 2019-07-03 | 2019-11-05 | 北京云迹科技有限公司 | Industrial personal computer bulk management method and system |
| CN112882752A (en) * | 2021-01-26 | 2021-06-01 | 苏州达家迎信息技术有限公司 | Method and device for batch processing of microservices, computer equipment and storage medium |
| CN112882752B (en) * | 2021-01-26 | 2022-10-28 | 苏州达家迎信息技术有限公司 | Method and device for processing micro services in batches, computer equipment and storage medium |
| CN113094185A (en) * | 2021-04-13 | 2021-07-09 | 中国工商银行股份有限公司 | Method and device for detecting parallel data processing abnormity of database batch program |
| CN114553660A (en) * | 2022-01-10 | 2022-05-27 | 北京思特奇信息技术股份有限公司 | Distributed system and operation and maintenance method for efficient operation and maintenance |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107193543B (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107193543A (en) | A kind of batch operation performs method and device | |
| US11689413B2 (en) | Configuring system resources for different reference architectures | |
| US11451451B2 (en) | Intent-based analytics | |
| US11677619B2 (en) | Selectable declarative requirement levels | |
| US11625293B1 (en) | Intent driven root cause analysis | |
| US10275776B1 (en) | Techniques for compliance testing | |
| US11567994B2 (en) | Configuration, telemetry, and analytics of a computer infrastructure using a graph model | |
| US20220224608A1 (en) | Verifying service status | |
| US7596550B2 (en) | System and method for query planning and execution | |
| US20090287643A1 (en) | Context based script generation | |
| CN107547263A (en) | A kind of method realized network element device automation and search template configuration | |
| CN105141441B (en) | A kind of method that IP network graphically configures | |
| US20080177720A1 (en) | System and method for query planning for execution using conditional operators | |
| US11552868B1 (en) | Collect and forward | |
| CN110020243A (en) | Querying method, device, Internet of Things server and the storage medium of internet of things data | |
| US7546292B2 (en) | Master-detail provider and method of providing master-detail functionality | |
| Luo et al. | Clustering and tailoring user session data for testing web applications | |
| Tragatschnig et al. | Runtime process adaptation for bpel process execution engines | |
| US10469319B2 (en) | Certification tool gap analyzer | |
| CN111625472A (en) | Unit testing method and device | |
| CN107729388B (en) | XML protocol-based app server implementation method | |
| CN115396152A (en) | Data isolation method and system for multi-tenant software-as-a-service platform | |
| KR101866820B1 (en) | Method for optimizing operation of game server | |
| Dubecký | Data service for Cybernetic Proving Ground’s visualizations | |
| Dubecký | Datová služba pro podporu vizualizací v kybernetickém polygonu |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |