CN107807608A - Data processing method, data handling system and storage medium - Google Patents
Data processing method, data handling system and storage medium Download PDFInfo
- Publication number
- CN107807608A CN107807608A CN201711066268.5A CN201711066268A CN107807608A CN 107807608 A CN107807608 A CN 107807608A CN 201711066268 A CN201711066268 A CN 201711066268A CN 107807608 A CN107807608 A CN 107807608A
- Authority
- CN
- China
- Prior art keywords
- data processing
- machine
- work machine
- master
- work
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
- G05B19/408—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by data handling or data format, e.g. reading, buffering or conversion of data
- G05B19/4083—Adapting programme, configuration
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/35—Nc in input of data, input till input file format
- G05B2219/35356—Data handling
Abstract
The present invention provides a kind of data processing method, and the data processing method includes step：Master machine receives data processing request；Master machine judges whether the Work machine in Work machine group is in idle condition；As Work machine is in idle condition, then data processing task corresponding to data processing request is sent to Work machine, and Work machine is switched into working condition；Wherein master machine presses setting time interval, and heartbeat detection instruction is sent to all working machine；And the Work machine in Work machine group is determined according to the instruction feedback of Work machine.The present invention also provides a kind of data handling system, data processing method of the invention and data handling system by Work machine group of the master machine control with least one Work machine, realizes multi-thread task processing to improve data-handling efficiency；Validation checking is carried out to all working machine in Work machine group using heartbeat detection instruction simultaneously, improves the validity of data processing.
Description
Technical field
The present invention relates to data processing field, more particularly to a kind of data processing method, data handling system and storage
Medium.
Background technology
When the data service systems such as existing nginx carry out data processing, row data processing can be typically deployed in simultaneously
Master machine (master machines) and corresponding Work machine (worker machines), i.e. master machine receive data processing request, then
By data processing request and corresponding data transfer to Work machine, finally it is responsible for specific data processing by Work machine
Logic, because Work machine individually associates with corresponding master machine, or even Work machine and master machine are uniform machinery, therefore can
To play the maximum performance of every Work machine.
But with the development of network, network data processing amount is increasing, and the data amount of calculation of single task role is also more next
It is bigger.The task huge in face of amount of calculation, master machine can not carry out dynamic expansion to the task with huge amount of calculation, so as to lead
Cause the reduction of the data-handling efficiency of partial task.
Existing data service system simultaneously, corresponding monitoring programme is not provided with to master machine and Work machine, such as main
Machine or Work machine collapse, data service system can only not responded by data processing request to be judged, causes data to take
The further reduction of the data-handling efficiency of business system.
The content of the invention
The embodiment of the present invention provides a kind of data-handling efficiency higher data processing method, data handling system and storage
Medium；To solve the relatively low technical problem of the data-handling efficiency of existing data processing method and data handling system.
The embodiment of the present invention provides a kind of data processing method, and data processing operation is carried out for data handling system, its
Described in data handling system include at least one master machine and a Work machine group, the Work machine group includes at least one
Individual Work machine, wherein the data processing method includes：
The master machine receives data processing request；
The master machine judges whether the Work machine in the Work machine group is in idle condition；And
Function as described machine and be in idle condition, then send data processing task corresponding to the data processing request
To the Work machine, and the Work machine is switched into working condition；
Wherein described master machine presses setting time interval, and heartbeat detection instruction is sent to all working machine；And according to institute
The instruction feedback for stating Work machine determines Work machine in the Work machine group.
The embodiment of the present invention also provides a kind of data handling system, and for carrying out data processing operation, it includes master machine
And a Work machine group, Work machine group include at least one Work machine；
Wherein described master machine includes：
Data processing request receiving module, for receiving data processing request；
Work machine condition judgment module, for judging whether the Work machine in the Work machine group is in idle shape
State；
Data processing task sending module, for data processing task corresponding to the data processing request to be sent to institute
Work machine is stated, and the Work machine is switched into working condition；
Heartbeat detection instruction sending module, for by setting time interval, sending heartbeat detection to all working machine and referring to
Order；And
Work machine group determining module, for being determined according to the instruction feedback of the Work machine in the Work machine group
Work machine.
Compared to prior art, data processing method of the invention, data handling system and storage medium pass through a main frame
Work machine group of the device control with multiple Work machines, multi-thread task processing is realized to improve data-handling efficiency；Simultaneously
Validation checking is carried out to all working machine in Work machine group using heartbeat detection instruction, improve data processing has
Effect property.Solves the relatively low technical problem of the data-handling efficiency of existing data processing method and data handling system.
Brief description of the drawings
Fig. 1 is the flow chart of the first preferred embodiment of the data processing method of the present invention；
Fig. 2 is the step S102 of the first preferred embodiment of the data processing method of present invention flow chart；
Fig. 3 is the flow chart of the second preferred embodiment of the data processing method of the present invention；
Fig. 4 is the structural representation of the first preferred embodiment of the data handling system of the present invention；
Fig. 5 is that the structure of the Work machine group determining module of the first preferred embodiment of the data handling system of the present invention is shown
It is intended to；
Fig. 6 is the structural representation of the second preferred embodiment of the data handling system of the present invention；
Fig. 7 is the structure of the data processing task sending module of the second preferred embodiment of the data handling system of the present invention
Schematic diagram；
Fig. 8 a are the system architecture diagram of the specific embodiment of the data handling system of the present invention；
Fig. 8 b be the present invention data processing method and data handling system specific embodiment workflow diagram；
Fig. 9 be the present invention data handling system part where electronic equipment working environment structural representation.
Embodiment
Schema is refer to, wherein identical element numbers represent identical component, and principle of the invention is to implement one
Illustrated in appropriate computing environment.The following description is based on the illustrated specific embodiment of the invention, and it should not be by
It is considered as the limitation present invention other specific embodiments not detailed herein.
In the following description, specific embodiment of the invention will be referred to as the operation performed by one or multi-section computer
The step of and symbol illustrate, unless otherwise stating clearly.Therefore, it will appreciate that these steps and operation, be carried for several times wherein having
To be performed by computer, include by representing with the computer disposal list of the electronic signal of the data in a structuring pattern
Member is manipulated.This manipulation transforms data or the opening position being maintained in the memory system of the computer, it can match somebody with somebody again
Put or change the running of the computer in a manner familiar to those skilled in the art in addition.The data knot that the data are maintained
Structure is the provider location of the internal memory, and it has the particular characteristics as defined in the data format.But the principle of the invention is with above-mentioned
Word illustrates, it is not represented as a kind of limitation, those skilled in the art will appreciate that plurality of step as described below and
Operation also may be implemented among hardware.
The data processing method and data handling system of the present invention can be used for business datum is handled and managed
In electronic equipment, the electronic equipment include but is not limited to wearable device, helmet, medical treatment ＆ health platform, personal computer,
Server computer, hand-held or laptop devices, mobile device (such as mobile phone, personal digital assistant (PDA), media
Player etc.), multicomputer system, consumer electronic devices, minicom, mainframe computer including above-mentioned any system
System or the DCE of equipment, etc..The electronic equipment is preferably the data service system of more machines such as nginx.This
The data processing method and data handling system of invention have the Work machine group of multiple Work machines by master machine control,
Multi-thread task processing is realized to improve data-handling efficiency；Simultaneously using heartbeat detection instruction to all in Work machine group
Work machine carries out validation checking, improves the validity of data processing；Effectively solves existing data processing method
And the relatively low technical problem of data-handling efficiency of data handling system.
Fig. 1 is refer to, Fig. 1 is the flow chart of the first preferred embodiment of the data processing method of the present invention.This is preferred real
Above-mentioned electronic equipment (data handling system) can be used to be implemented for the data processing method for applying example, so as to data handling system
Carry out data processing operation.The data handling system includes at least one master machine and with Work machine group, the Work machine
Group includes at least one Work machine.Wherein master machine is scheduled for data processing task, and Work machine is used for data
Processing task calculation process.The data processing method of this preferred embodiment includes：
Step S101, master machine receive data processing request；
Step S102, master machine judge whether the Work machine in Work machine group is in idle condition；
Step S103, as Work machine is in idle condition, then master machine is by data processing corresponding to data processing request
Task is sent to Work machine, and Work machine is switched into working condition.
The following detailed description of the idiographic flow of each step of the data processing method of this preferred embodiment.
In step S101, the data processing request outside master machine reception, the data processing request is at request data
Reason system carries out the request of data task processing.Then pass to step S102.
In step s 102, master machine obtains the Work machine in Work machine group, and judges the work in Work machine group
Make whether machine is in idle condition.Here Work machine group includes multiple Work machines in normal operating conditions.It is main
The data processing task of data processing request can be issued to Work machine and carry out multiple threads by machine.Therefore data are being issued
Before processing task, master machine needs to prejudge whether the Work machine is in idle condition, i.e., does not handle other data
Processing task.Then pass to step S103.
In step s 103, as some Work machine in judgment step S102 is in idle condition, then master machine will walk
Data processing task corresponding to the data processing request that rapid S101 is obtained, which is sent to the Work machine, to be handled, and is such as passed through
The DLLs such as socket send data processing task to Work machine；And the Work machine is switched into working condition.Such as
Some Work machine in judgment step S102 is in running order, then not sending any data processing to the Work machine appoints
Business.
Specifically, in the step S102 of this preferred embodiment, master machine can obtain Work machine group by below scheme
In Work machine.Fig. 2 is refer to, Fig. 2 is the step S102's of the first preferred embodiment of the data processing method of the present invention
Flow chart.Step S102 includes：
Step S201, master machine press setting time interval, send heartbeat detection instruction to all working machine, and receive work
Make the instruction feedback of machine.
Because master machine and Work machine are separately controlled, i.e., the working machine that master machine is made up of multiple Work machines
Device group carries out data processing task control.Therefore master machine is needed to the working machine in machine operation group in the preferred embodiment
Device availability deciding, i.e. master machine can send heartbeat detection instruction by setting time interval to all working machine, and according to work
Make the instruction feedback that machine instructs for the heartbeat detection, determine whether the Work machine is effective, if needs remain in
In Work machine group.
Step S202, as Work machine to heartbeat detection instruct Normal Feedback, then illustrate that the Work machine is in normal work
Make state, then the Work machine is arranged in Work machine group by master machine.Specifically, as the Work machine is in Work machine
Group, then master machine the Work machine is continually maintained in Work machine group；Such as the Work machine is not in Work machine group, then
The Work machine is added in Work machine group by master machine, to issue data processing task to the Work machine in time.
Step S203, as Work machine to heartbeat detection instruction exception feed back, then illustrate that the Work machine is in abnormal shape
State, because the Work machine in abnormality can not be effectively treated to data processing task, therefore master machine meeting here
Whether Work machine is judged in Work machine group.
Step S204, Work machine group such as is in the Work machine of abnormality, then master machine is by the Work machine
Rejected from Work machine group；Such as the Work machine in abnormality is not in Work machine group, then master machine is not to the work
Machine does any operation.
So complete the flow chart of data processing of the data processing method of this preferred embodiment.
The data processing method of this preferred embodiment passes through Work machine of the master machine control with multiple Work machines
Group, multi-thread task processing is realized to improve data-handling efficiency；Instructed simultaneously using heartbeat detection in Work machine group
All working machine carries out validation checking, improves the validity of data processing.
Fig. 3 is refer to, Fig. 3 is the flow chart of the second preferred embodiment of the data processing method of the present invention.This is preferred real
Above-mentioned electronic equipment (data handling system) can be used to be implemented for the data processing method for applying example, so as to data handling system
Carry out data processing operation.The data handling system includes multiple main frames device, application program Coordination module, data processing task number
According to storehouse and Work machine group, the Work machine group includes at least one Work machine.Wherein master machine is appointed for data processing
Business is scheduled, and Work machine is used for data processing task calculation process, and application program Coordination module is used to determine master machine
State of activation, data processing task database be used for data storage processing request and corresponding data.This preferred embodiment
Data processing method includes：
Step S301, application program Coordination module determines that a master machine in multiple main frames device is active, more
Other master machines in individual master machine are in unactivated state；
Step S302, the master machine being active receive data processing request from data processing task database；
Step S303, master machine judge whether the Work machine in Work machine group is in idle condition；
Step S304, as Work machine is in idle condition, then master machine is by data processing corresponding to data processing request
Task, split by the setting workload of Work machine；
Step S305, master machine send the data processing task after segmentation to corresponding Work machine, and by working machine
Device switches to working condition；
Step S306, Work machine switch to idle condition, and send out to master machine after data processing task is finished
Machine idle is sent to instruct.
The following detailed description of the idiographic flow of each step of the data processing method of this preferred embodiment.
It is abnormal in order to prevent from master machine from occurring crashing etc. in step S301, thus notebook data processing system include it is multiple
Master machine, there is a master machine to be active at any time, other master machines are in unactivated state.Such as state of activation
Master machine abnormal, the open source software such as application program Coordination module such as Zookeeper such as occur crashing, can be by multiple main frames device
In other master machine be arranged to state of activation, such as pass through the master machine of other All hosts devices election generation state of activation
Deng；Other master machines in multiple main frames device are arranged to unactivated state.So it can preferably ensure that random time has
One is in the master machine of normal operating conditions.The application program Coordination module can be provided separately within an independent machine, also may be used
It is set directly in multiple main frames device.Then pass to step S302.
In step s 302, the master machine being active receives data processing from data processing task database please
Ask.In order to strengthen the treatment effeciency of data processing task, use data processing task database right in advance in this preferred embodiment
Data processing request and corresponding data are stored；So master machine can be received directly from data processing task database
Data processing request, and data processing request and corresponding data data processing task data can be directly stored in by technical staff can
Permanent storage.The data processing request is the request that request data processing system carries out data task processing.Then pass to step
S303。
In step S303, master machine obtains the Work machine in Work machine group, and judges the work in Work machine group
Make whether machine is in idle condition.Here Work machine group includes multiple Work machines in normal operating conditions.It is main
The data processing task of data processing request can be issued to Work machine and carry out multiple threads by machine.Therefore data are being issued
Before processing task, master machine needs to prejudge whether the Work machine is in idle condition, i.e., does not handle other data
Processing task.Then pass to step S304.
In step s 304, as some Work machine in judgment step S303 is in idle condition, then master machine will walk
Data processing task corresponding to the data processing request that rapid S302 is obtained, is split by the setting workload of the Work machine,
So that the more Work machines are handled the data processing task of big data quantity.Such as by Work machine A, Work machine B with
And Work machine C setting workload is respectively 1:2:3, then master machine data processing task can be averagely divided into 6 parts, by 1:
2:3 pro rate is to Work machine A, Work machine B and Work machine C.Then pass to step S305.
In step S305, the data processing task after segmentation is sent to the Work machine and handled by master machine, and
The Work machine is switched into working condition.It is as some Work machine in judgment step S304 is in running order, then not right
The Work machine sends any data processing task.Then pass to step S306.
In step S306, in order to further improve the treatment effeciency of the data processing task of data handling system, work
Work machine can be switched to idle condition by machine automatically after data processing task is finished, and to master machine transmitter
Device idle instruction.So master machine can understand the working condition of all working machine in Work machine group in time, facilitate data
Processing task issues in time.
So complete the flow chart of data processing of the data processing method of this preferred embodiment.
On the basis of first preferred embodiment, the data processing method of this preferred embodiment coordinates mould by application program
The setting of block, further increase the stability of data processing method work；Master machine can be according to the setting work of Work machine
Amount is split to data processing task, is handled by multiple Work machines data processing task larger to data volume,
Improve the data-handling efficiency of data processing task；Certainly be about to working condition feeds back to master machine to Work machine, further carries
High acquisition speed of the master machine to the working condition of Work machine in Work machine group.
The present invention also provides a kind of data handling system, refer to Fig. 4, and Fig. 4 is the of the data handling system of the present invention
The structural representation of one preferred embodiment.Above-mentioned data processing method can be used in the data handling system of this preferred embodiment
First preferred embodiment is implemented, and the data handling system 40 of this preferred embodiment includes the Work machine of master machine 41 and one
Group 42, the Work machine group 42 includes at least one Work machine 421.
Wherein master machine 41 includes data processing request receiving module 411, Work machine condition judgment module 412, data
Processing task sending module 413, heartbeat detection instruction sending module 414 and Work machine group determining module 415.
Data processing request receiving module 411 is used to receive data processing request；Work machine condition judgment module 412 is used
In judging whether the Work machine in Work machine group is in idle condition；Data processing task sending module 413 is used for number
Sent according to data processing task corresponding to processing request to Work machine, and Work machine is switched into working condition；Heartbeat is examined
Survey instruction sending module 414 to be used to press setting time interval, heartbeat detection instruction is sent to all working machine；Work machine group
Determining module 415 is used to determine the Work machine in Work machine group according to the instruction feedback of Work machine.
Fig. 5 is refer to, Fig. 5 is that the Work machine group of the first preferred embodiment of the data handling system of the present invention determines mould
The structural representation of block.The Work machine group determining module 415 includes the first setting unit 4151 and the second setting unit
4152.First setting unit 4151 is used for Work machine 421 such as and instructs Normal Feedback to heartbeat detection, then by Work machine 421
It is arranged in Work machine group 42；Second setting unit 4152 is used for Work machine 421 such as and heartbeat detection instruction exception is fed back,
And Work machine 421 is in Work machine group 42, then Work machine 421 is rejected from Work machine group 42.
The data handling system 40 of this preferred embodiment is in use, the data processing request receiving module of master machine 41 first
Data processing request outside 411 receptions, the data processing request are that request data processing system carries out data task processing
Request.
The Work machine condition judgment module 412 of subsequent master machine 41 obtains the Work machine 421 in Work machine group 42,
And judge whether the Work machine 421 in Work machine group 42 is in idle condition.Here Work machine group 42 includes multiple
Work machine 421 in normal operating conditions.The data processing task of data processing request can be issued to work by master machine 41
Make machine 421 and carry out multiple threads.Therefore before data processing task is issued, master machine 41 needs to prejudge the work
Whether machine is in idle condition, i.e., does not handle other data processing tasks.
Then as judged that some Work machine 421 in Work machine group 42 is in the number of idle condition, then master machine 41
Data processing task corresponding to the data processing request of acquisition is sent to the Work machine according to processing task sending module 413
Row processing, is such as sent data processing task to Work machine 421 by socket DLLs；And by the Work machine
421 switch to working condition.Such as judge that some Work machine 421 in Work machine group 42 is in running order, then not to this
Work machine 421 sends any data processing task.
Specifically, master machine 41 can obtain the Work machine 421 in Work machine group 42 by below scheme.
The heartbeat detection instruction sending module 414 of master machine 41 presses setting time interval first, to all working machine 421
Heartbeat detection instruction is sent, and receives the instruction feedback of Work machine 421.
Because master machine 41 and Work machine 421 are separately controlled, i.e., master machine 41 passes through multiple 421 groups of Work machines
Into Work machine group 42 carry out data processing task control.Therefore master machine 41 is needed to machine work in the preferred embodiment
The availability deciding of Work machine 421 in work group 42, i.e. master machine 41 can be by setting time intervals, to all working machine 421
Heartbeat detection instruction, and the instruction feedback instructed according to Work machine 421 for the heartbeat detection are sent, determines the Work machine
Whether 421 is effective, if needs to remain in Work machine group 42.
As Work machine 421 to heartbeat detection instruct Normal Feedback, then illustrate that the Work machine 421 is in normal work shape
The Work machine 421 is arranged on Work machine group 42 by state, the first setting unit 4151 of Work machine group determining module 415
In.Specifically, be in Work machine group 42 such as the Work machine 421, then the first setting unit 4151 by the Work machine 421 after
It is continuous to be maintained in Work machine group 42；Such as the Work machine 421 is not in Work machine group 42, then the first setting unit 4151 will
The Work machine 421 is added in Work machine group 42, to issue data processing task to the Work machine 421 in time.
As Work machine 421 to heartbeat detection instruction exception feed back, then illustrate that the Work machine 421 is in abnormality,
Because the Work machine 421 in abnormality can not be effectively treated to data processing task, therefore Work machine here
Whether the second setting unit 4152 of group determining module 415 can be judged in Work machine group 42 Work machine 421.
Work machine group 42 such as is in the Work machine 421 of abnormality, then the second setting unit 4152 is by the work
Make machine 421 to reject from Work machine group 42；Such as the Work machine 421 in abnormality is not in Work machine group 42, then
Second setting unit 4152 does not do any operation to the Work machine.
So complete the flow chart of data processing of the data handling system 40 of this preferred embodiment.
The data handling system of this preferred embodiment passes through Work machine of the master machine control with multiple Work machines
Group, multi-thread task processing is realized to improve data-handling efficiency；Instructed simultaneously using heartbeat detection in Work machine group
All working machine carries out validation checking, improves the validity of data processing.
Fig. 6 is refer to, Fig. 6 is the structural representation of the second preferred embodiment of the data handling system of the present invention.This is excellent
The data handling system of embodiment is selected the second preferred embodiment of above-mentioned data processing method to can be used to be implemented, this is preferably
The data handling system 60 of embodiment includes multiple main frames device 61, application program Coordination module 62, data processing task database
63 and Work machine group 64, the Work machine group 64 include at least one Work machine 641.Wherein master machine 61 is used for data
Processing task is scheduled, and Work machine 641 is used to be used for data processing task calculation process, application program Coordination module 62
The state of activation of master machine 61 is determined, data processing task database 63 is used for data storage processing request and corresponding data.
Wherein master machine 61 includes data processing request receiving module 611, Work machine condition judgment module 612, data
Processing task sending module 613, heartbeat detection instruction sending module 614 and Work machine group determining module 615.
Data processing request receiving module 611 is used to receive data processing request from data processing task database 63；Work
Make machine state judge module 612 to be used to judge whether the Work machine 641 in Work machine group is in idle condition；At data
Reason task sending module 613 is used to send data processing task corresponding to data processing request to Work machine 641, and by work
Make machine 641 and switch to working condition；Heartbeat detection instruction sending module 614 is used to press setting time interval, to all working
Machine 641 sends heartbeat detection instruction；Work machine group determining module 615 is true for the instruction feedback according to Work machine 641
Determine the Work machine 641 in Work machine group 64.
Work machine 641 includes being used for after data processing task is finished, and switches to idle condition, and to master machine
The machine idle instruction sending module of distribution of machine idle instruction.
Fig. 7 is refer to, Fig. 7 is that the data processing task of the second preferred embodiment of the data handling system of the present invention is sent
The structural representation of module.The data processing task sending module 613 includes data processing task cutting unit 6131 and number
According to processing task transmitting element 6132.
Data processing task cutting unit 6131 is used for data processing task corresponding to data processing request, by working machine
The setting workload of device is split；Data processing task transmitting element 6132 is used to send the data processing task after segmentation
To corresponding Work machine 641.
The data handling system 60 of this preferred embodiment in use, abnormal in order to prevent from master machine 61 from occurring crashing etc., because
This notebook data processing system 60 includes multiple main frames device 61, has a master machine 61 to be active at any time, other
Master machine 61 is in unactivated state.There is abnormal, the application program Coordination module 62 that crashes in the master machine 61 of such as state of activation
Such as Zookeeper open source softwares, other master machine 61 in multiple main frames device 61 can be arranged to state of activation, such as
Master machine 61 of generation state of activation etc. is elected by other All hosts devices 61；By other master machines in multiple main frames device 61
61 are arranged to unactivated state.It so can preferably ensure that random time has a master machine for being in normal operating conditions
61.The application program Coordination module 62 can be provided separately within an independent machine, can also be set directly at multiple main frames device 61
In.
Then in state of activation master machine 61 data processing request receiving module 611 from data processing task data
Storehouse 63 receives data processing request.In order to strengthen the treatment effeciency of data processing task, used in this preferred embodiment at data
Reason assignment database 63 stores to data processing request and corresponding data in advance；So master machine 61 can directly from
Data processing task database 63 receives data processing request, and data processing request and corresponding data can be straight by technical staff
Connect the permanent storage of deposit data processing task database 63.The data processing request is that request data processing system carries out data times
The request of business processing.
Then the Work machine condition judgment module 612 of master machine 61 obtains the Work machine in Work machine group, and sentences
Whether the Work machine 641 in disconnected Work machine group 64 is in idle condition.Here Work machine group 64 includes multiple be in
The Work machine 641 of normal operating conditions.The data processing task of data processing request can be issued to working machine by master machine 61
Device 641 carries out multiple threads.Therefore before data processing task is issued, master machine 61 needs to prejudge the Work machine
Whether 641 be in idle condition, i.e., does not handle other data processing tasks.
Specifically, master machine 61 can obtain the Work machine 641 in Work machine group 64 by below scheme.
The heartbeat detection instruction sending module 614 of master machine 61 presses setting time interval first, to all working machine 641
Heartbeat detection instruction is sent, and receives the instruction feedback of Work machine 641.The Work machine group 64 of subsequent master machine 61 determines mould
Root tuber determines the Work machine 641 in Work machine group 64 according to the instruction feedback of Work machine 641.
Then such as judge that some Work machine 641 is in idle condition, then the data processing task of master machine 61 sends mould
The data processing task cutting unit 6131 of block 613 is by data processing task corresponding to the data processing request of acquisition, by the work
The setting workload for making machine 641 is split, so that the more Work machines 641 enter to the data processing task of big data quantity
Row processing.It is respectively 1 such as by Work machine A, Work machine B and Work machine C setting workload:2:3, then master machine can
Data processing task is averagely divided into 6 parts, by 1:2:3 pro rate is to Work machine A, Work machine B and working machine
Device C.
The data processing task transmitting element 6132 of the data processing task sending module 613 of last master machine 61 will be split
Data processing task afterwards is sent to the Work machine 641 and handled, and the Work machine 641 is switched into working condition.
As judged, some Work machine 641 is in running order, then does not send any data processing task to the Work machine 641.
In order to further improve the treatment effeciency of the data processing task of data handling system 60, Work machine 641 is in number
After according to processing tasks carrying, Work machine 641 can be switched into idle condition automatically, and to the machine idle of master machine 61
Command reception module distribution of machine idle instruction.So master machine 61 can understand all working machine in Work machine group 64 in time
The working condition of device 641, facilitate issuing in time for data processing task.
So complete the flow chart of data processing of the data handling system 60 of this preferred embodiment.
On the basis of first preferred embodiment, the data handling system of this preferred embodiment coordinates mould by application program
The setting of block, further increase the stability of data processing method work；Master machine can be according to the setting work of Work machine
Amount is split to data processing task, is handled by multiple Work machines data processing task larger to data volume,
Improve the data-handling efficiency of data processing task；Certainly be about to working condition feeds back to master machine to Work machine, further carries
High acquisition speed of the master machine to the working condition of Work machine in Work machine group.
Illustrate the data processing method of the present invention and the specific works of data handling system below by a specific embodiment
Principle.It refer to the system architecture diagram of the specific embodiment for the data handling system that Fig. 8 a and Fig. 8 b, Fig. 8 a are the present invention, Fig. 8 b
The workflow diagram of the specific embodiment of data processing method and data handling system for the present invention.The number of this specific embodiment
Include multiple main frames device 81, independent application program Coordination module 82 (Zookeeper), data processing task according to processing system 80
Database 83 (database) and the Work machine group 84 with multiple Work machines 841.At the data of this specific embodiment
The flow that reason system 80 carries out data processing includes：
Step S801, Zookeeper determine the master machine 81 of a state of activation, and other master machines are arranged to inactive shape
State.Master machine such as state of activation is in abnormality, then Zookeeper reaffirms from the master machine in unactivated state
The master machine of one state of activation.
Step S802, the master machine of state of activation obtain nodal information (such as ip addresses and the port numbers of all working machine
Deng)；And send heartbeat detection instruction to all working machine by setting time interval.As Work machine instructs to the heartbeat detection
Normal Feedback, then the Work machine is arranged in Work machine group；As Work machine to the heartbeat detection instruction exception feed back,
Then the Work machine is rejected from Work machine group.
Step S803, the master machine of state of activation receive data processing request from data processing task database.
Step S804, the master machine of state of activation are split to data processing task corresponding to data processing request.
Step S805, the master machine of state of activation send the data processing task after segmentation to the work in idle condition
Make machine, and the Work machine is switched into working condition.
Step S806, the master machine of state of activation press setting time interval, and whether inquiry Work machine completes data processing
Task, or Work machine switch to idle condition after data processing task is finished, and idle to master machine distribution of machine
Instruction.
So complete the data processing method of this specific embodiment and the flow chart of data processing of data handling system.
The data processing method and data handling system of the present invention has multiple Work machines by master machine control
Work machine group, realize the processing of multi-thread task to improve data-handling efficiency, so as to it is rapid, accurately complete data processing
Task.
Validation checking is carried out to all working machine in Work machine group using heartbeat detection instruction simultaneously, realized
Being automatically added to for the automatic rejection of non-productive work machine and effective Work machine, is greatly saved manpower maintenance cost, carries
The high validity of data processing.The data-handling efficiency for solving existing data processing method and data handling system is relatively low
Technical problem.
" component ", " module ", " system ", " interface ", " process " etc. are usually intended to as used herein the term
Refer to computer related entity：Hardware, the combination of hardware and software, software or executory software.For example, component can be but not
It is limited to run process on a processor, processor, object, executable application, thread, program and/or the computer performed.
By diagram, it can be component to run both application and controllers on the controller.One or more assemblies can have
It is in process and/or the thread of execution, and component can be located on a computer and/or be distributed in two or more meters
Between calculation machine.
Fig. 9 and the discussion below provide to realize data handling system of the present invention part where electronics set
Brief, summary the description of standby working environment.Fig. 9 working environment be only an example of appropriate working environment and
Be not intended to suggestion on working environment purposes or function scope any restrictions.Example electronic equipment 912 includes but unlimited
In wearable device, helmet, medical treatment ＆ health platform, personal computer, server computer, hand-held or on knee set
Standby, mobile device (such as mobile phone, personal digital assistant (PDA), media player etc.), multicomputer system, consumption
Type electronic equipment, minicom, mainframe computer including above-mentioned arbitrarily DCE of system or equipment, etc..
Although not requiring, in the common background that " computer-readable instruction " is performed by one or more electronic equipments
Lower description embodiment.Computer-readable instruction can be distributed and (be discussed below) via computer-readable medium.It is computer-readable
Instruction can be implemented as program module, for example performs particular task or realize the function of particular abstract data type, object, application
DLL (API), data structure etc..Typically, the function of the computer-readable instruction can be in various environment arbitrarily
Combination or distribution.
Fig. 9 illustrates the electronic equipment 912 of one or more of the data handling system including present invention embodiment
Example.In one configuration, electronic equipment 912 includes at least one processing unit 916 and memory 918.According to electronic equipment
Exact configuration and type, memory 918 can be volatibility (such as RAM), non-volatile (such as ROM, flash memory etc.)
Or certain combination of the two.The configuration is illustrated by dotted line 914 in fig.9.
In other embodiments, electronic equipment 912 can include supplementary features and/or function.For example, equipment 912 may be used also
So that including additional storage device (such as removable and/or non-removable), it includes but is not limited to magnetic memory apparatus, light is deposited
Storage device etc..This additional memory devices are illustrated by storage device 920 in fig.9.In one embodiment, for realizing this
The computer-readable instruction for one or more embodiments that text is provided can be in storage device 920.Storage device 920 may be used also
To store other computer-readable instructions for being used for realizing operating system, application program etc..Computer-readable instruction can be loaded into
Performed in memory 918 by such as processing unit 916.
Term as used herein " computer-readable medium " includes computer-readable storage medium.Computer-readable storage medium includes
The volatibility realized for any method or technique of the information of storage such as computer-readable instruction or other data etc
With non-volatile, removable and nonremovable medium.Memory 918 and storage device 920 are the examples of computer-readable storage medium.
Computer-readable storage medium includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital universal
Disk (DVD) or other light storage devices, cassette tape, tape, disk storage device or other magnetic storage apparatus can be used for
Information and any other medium that can be accessed by electronic equipment 912 it is expected in storage.Any such computer-readable storage medium can
To be a part for electronic equipment 912.
Electronic equipment 912 can also include the communication connection 926 for allowing electronic equipment 912 to be communicated with other equipment.Communication
Connection 926 can include but is not limited to modem, NIC (NIC), integrated network interface, radiofrequency launcher/connect
Receive device, infrared port, USB connections or other interfaces for electronic equipment 912 to be connected to other electronic equipments.Communication connection
926 can include wired connection or wireless connection.Communication connection 926 can launch and/or receive communication medium.
Term " computer-readable medium " can include communication media.Communication media typically comprises computer-readable instruction
Or other data in " the own modulated data signal " of such as carrier wave or other transmission mechanisms etc, and passed including any information
Send medium.Term " own modulated data signal " can include such signal：One or more of the characteristics of signals is according to general
Information is encoded to the mode in signal to be set or changed.
Electronic equipment 912 can include input equipment 924, such as keyboard, mouse, pen, voice-input device, touch input
Equipment, infrared camera, video input apparatus and/or any other input equipment.Output equipment can also be included in equipment 912
922, such as one or more displays, loudspeaker, printer and/or other any output equipments.Input equipment 924 and output
Equipment 922 can be connected to electronic equipment 912 via wired connection, wireless connection or its any combination.In one embodiment,
Input equipment or output equipment from another electronic equipment are used as the input equipment 924 or defeated of electronic equipment 912
Go out equipment 922.
The component of electronic equipment 912 can be connected by various interconnection (such as bus).Such interconnection can include outer
Enclose component interconnection (PCI) (such as quick PCI), USB (USB), live wire (IEEE1394), optical bus structure etc.
Deng.In another embodiment, the component of electronic equipment 912 can pass through network interconnection.For example, memory 918 can be by position
Multiple physical memory cells arcs composition in different physical locations, by network interconnection.
It would be recognized by those skilled in the art that can be across network point for the storage device for storing computer-readable instruction
Cloth.For example, it be able to can be stored via the electronic equipment 930 that network 928 accesses for realizing one provided by the present invention or more
The computer-readable instruction of individual embodiment.Electronic equipment 912 can access electronic equipment 930 and downloading computer readable instruction
It is part or all of for perform.Alternately, electronic equipment 912 can download a plurality of computer-readable instruction on demand,
Or some instructions can be performed at electronic equipment 912 and some instructions can perform at electronic equipment 930.
There is provided herein the various operations of embodiment.In one embodiment, described one or more operations can be with structure
The computer-readable instruction stored on into one or more computer-readable mediums, it will make to succeed in one's scheme when being performed by electronic equipment
Calculate equipment and perform the operation.Describing the orders of some or all of operations, to should not be construed as to imply that these operations necessarily suitable
Sequence correlation.It will be appreciated by those skilled in the art that the alternative sequence of the benefit with this specification.Furthermore, it is to be understood that
Not all operation must exist in each embodiment provided in this article.
Moreover, although having shown and described the disclosure relative to one or more implementations, but this area skill
Art personnel are based on the reading to the specification and drawings and understand it will be appreciated that equivalent variations and modification.The disclosure include it is all this
The modifications and variations of sample, and be limited only by the scope of the following claims.In particular, to by said modules (such as element,
Resource etc.) various functions that perform, the term for describing such component is intended to correspond to the specified work(for performing the component
The random component (unless otherwise instructed) of energy (such as it is functionally of equal value), it is illustrated herein with execution in structure
The disclosure exemplary implementations in function open structure it is not equivalent.In addition, although the special characteristic of the disclosure
Through being disclosed relative to the only one in some implementations, but this feature can with such as can be to given or application-specific
For be it is expected and other one or more combinations of features of other favourable implementations.Moreover, with regard to term " comprising ", " tool
Have ", " containing " or its deformation be used in embodiment or claim for, such term be intended to with term
The similar mode of "comprising" includes.
Each functional unit in the embodiment of the present invention can be integrated in a processing module or unit list
Solely be physically present, can also two or more units be integrated in a module.Above-mentioned integrated module can both use
The form of hardware is realized, can also be realized in the form of software function module.If the integrated module is with software function
The form of module is realized and is used as independent production marketing or is situated between in use, a computer-readable storage can also be stored in
In matter.Storage medium mentioned above can be read-only storage, disk or CD etc..Above-mentioned each device or system, can be with
Perform the method in correlation method embodiment.
In summary, although the present invention is disclosed above with embodiment, the sequence number before embodiment only makes for convenience of description
With not causing to limit to the order of various embodiments of the present invention.Also, above-described embodiment is simultaneously not used to the limitation present invention, this area
Those of ordinary skill, without departing from the spirit and scope of the present invention, can make it is various change and retouching, therefore the present invention
Protection domain is defined by the scope that claim defines.
Claims (15)
1. a kind of data processing method, data processing operation is carried out for data handling system, wherein the data handling system
Including at least one master machine and a Work machine group, the Work machine group includes at least one Work machine, its feature
It is, the data processing method includes：
The master machine receives data processing request；
The master machine judges whether the Work machine in the Work machine group is in idle condition；And
Function as described machine and be in idle condition, then send data processing task corresponding to the data processing request to institute
Work machine is stated, and the Work machine is switched into working condition；
Wherein described master machine presses setting time interval, and heartbeat detection instruction is sent to all working machine；And according to the work
The instruction feedback for making machine determines Work machine in the Work machine group.
2. data processing method according to claim 1, it is characterised in that the instruction feedback according to Work machine is true
The step of determining the Work machine in the Work machine group includes：
Function as described machine and Normal Feedback is instructed to the heartbeat detection, then the Work machine is arranged on the working machine
In device group；
Function as described machine to feed back the heartbeat detection instruction exception, then judge whether the Work machine is in the work
Make in machine group；
In the Work machine group as described in, then the Work machine is rejected from the Work machine group.
3. data processing method according to claim 1, it is characterised in that the data handling system includes multiple main frames
Device and the application program Coordination module being connected with All hosts device；
The data processing method also includes：
The application program Coordination module determines that a master machine in multiple main frames device is active, in multiple main frames device
Other master machines be in unactivated state.
4. data processing method according to claim 3, it is characterised in that the application program Coordination module determines multiple
A step of master machine in master machine is active, and other master machines in multiple main frames device are in unactivated state
Including：
Such as all master machines are in unactivated state, then application program Coordination module specifies a master machine to switch to activation shape
State.
5. data processing method according to claim 1, it is characterised in that the data handling system also includes being used to deposit
Store up the data processing task database of the data processing request and corresponding data；
The master machine receives data processing request from the data processing task database.
6. data processing method according to claim 5, it is characterised in that described by corresponding to the data processing request
Data processing task, which was sent to the step of Work machine, to be included：
The master machine is by data processing task corresponding to the data processing request, by the setting workload of the Work machine
Split；And
The master machine sends the data processing task after segmentation to corresponding Work machine.
7. data processing method according to claim 1, it is characterised in that the data processing method also includes：
The master machine receives the machine idle instruction of the Work machine, wherein machine idle instruction is by the working machine
Device is finished in data processing task, is generated when switching to idle condition.
8. a kind of data handling system, for carrying out data processing operation, it is characterised in that including master machine and a working machine
Device group, Work machine group include at least one Work machine；
Wherein described master machine includes：
Data processing request receiving module, for receiving data processing request；
Work machine condition judgment module, for judging whether the Work machine in the Work machine group is in idle condition；
Data processing task sending module, for data processing task corresponding to the data processing request to be sent to the work
Make machine, and the Work machine is switched into working condition；
Heartbeat detection instruction sending module, for by setting time interval, heartbeat detection instruction to be sent to all working machine；With
And
Work machine group determining module, for determining the work in the Work machine group according to the instruction feedback of the Work machine
Make machine.
9. data handling system according to claim 8, it is characterised in that the Work machine group determining module includes：
First setting unit, Normal Feedback is instructed to the heartbeat detection for functioning as described machine, then by the working machine
Device is arranged in the Work machine group；And
Second setting unit, the heartbeat detection instruction exception is fed back for functioning as described machine, and the Work machine
In Work machine group, then the Work machine is rejected from the Work machine group.
10. data handling system according to claim 8, it is characterised in that the data handling system also includes multiple
Master machine and the application program Coordination module being connected with All hosts device；
The application program Coordination module is used to determine that a master machine in multiple main frames device is active, multiple main frames
Other master machines in device are in unactivated state.
11. data handling system according to claim 10, it is characterised in that the application program Coordination module is additionally operable to
Such as all master machines are in unactivated state, then formulate a master machine and switch to state of activation.
12. data handling system according to claim 8, it is characterised in that the data handling system also includes being used for
Store the data processing task database of the data processing request and corresponding data；
The data processing request receiving module is used to receive data processing request from the data processing task database.
13. data handling system according to claim 12, it is characterised in that the data processing task sending module bag
Include：
Data processing task cutting unit, for by data processing task corresponding to the data processing request, by the work
The setting workload of machine is split；And
Data processing task transmitting element, for the data processing task after segmentation to be sent to corresponding Work machine.
14. data handling system according to claim 8, it is characterised in that the master machine also includes：
Machine idle command reception module, the machine idle for receiving the Work machine instructs, wherein the machine idle
Instruction is finished by the Work machine in data processing task, is generated when switching to idle condition.
15. a kind of storage medium, processor-executable instruction is stored with, the instruction is by one or more processors
Loading, to perform such as data processing method any in claim 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711066268.5A CN107807608A (en) | 2017-11-02 | 2017-11-02 | Data processing method, data handling system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711066268.5A CN107807608A (en) | 2017-11-02 | 2017-11-02 | Data processing method, data handling system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107807608A true CN107807608A (en) | 2018-03-16 |
Family
ID=61590619
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711066268.5A Pending CN107807608A (en) | 2017-11-02 | 2017-11-02 | Data processing method, data handling system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107807608A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020042162A1 (en) * | 2018-08-31 | 2020-03-05 | 西门子股份公司 | Control method, device, and system |
| US11574290B2 (en) | 2019-01-23 | 2023-02-07 | Tencent Technology (Shenzhen) Company Limited | Data processing method and apparatus, computer device, and storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102208988A (en) * | 2010-03-29 | 2011-10-05 | 华为技术有限公司 | Message processing method, system and equipment thereof |
| CN103118130A (en) * | 2013-02-25 | 2013-05-22 | 汉柏科技有限公司 | Cluster management method and cluster management system for distributed service |
| CN103500173A (en) * | 2013-09-03 | 2014-01-08 | 北京泰乐德信息技术有限公司 | Method for inquiring rail transit monitoring data |
| CN103500119A (en) * | 2013-09-06 | 2014-01-08 | 西安交通大学 | Task allocation method based on pre-dispatch |
| CN103647668A (en) * | 2013-12-16 | 2014-03-19 | 上海证券交易所 | Host group decision system in high availability cluster and switching method for host group decision system |
| CN103729257A (en) * | 2012-10-16 | 2014-04-16 | 阿里巴巴集团控股有限公司 | Distributed parallel computing method and system |
| CN103970611A (en) * | 2014-05-05 | 2014-08-06 | 神华集团有限责任公司 | Task processing method based on computer cluster |
| CN103973725A (en) * | 2013-01-28 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Distributed collaboration method and collaboration device |
| CN105243125A (en) * | 2015-09-29 | 2016-01-13 | 北京京东尚科信息技术有限公司 | PrestoDB cluster running method and apparatus, cluster and data query method and apparatus |
| CN105373431A (en) * | 2015-10-29 | 2016-03-02 | 武汉联影医疗科技有限公司 | Computer system resource management method and computer resource management system |
| CN106330595A (en) * | 2015-07-02 | 2017-01-11 | 阿里巴巴集团控股有限公司 | Heartbeat detection method and apparatus of distributed platform |
| CN106851213A (en) * | 2017-03-06 | 2017-06-13 | 深圳市博信诺达经贸咨询有限公司 | The packet method for allocating tasks and system of cloud platform in monitoring system |
-
2017
- 2017-11-02 CN CN201711066268.5A patent/CN107807608A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102208988A (en) * | 2010-03-29 | 2011-10-05 | 华为技术有限公司 | Message processing method, system and equipment thereof |
| CN103729257A (en) * | 2012-10-16 | 2014-04-16 | 阿里巴巴集团控股有限公司 | Distributed parallel computing method and system |
| CN103973725A (en) * | 2013-01-28 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Distributed collaboration method and collaboration device |
| CN103118130A (en) * | 2013-02-25 | 2013-05-22 | 汉柏科技有限公司 | Cluster management method and cluster management system for distributed service |
| CN103500173A (en) * | 2013-09-03 | 2014-01-08 | 北京泰乐德信息技术有限公司 | Method for inquiring rail transit monitoring data |
| CN103500119A (en) * | 2013-09-06 | 2014-01-08 | 西安交通大学 | Task allocation method based on pre-dispatch |
| CN103647668A (en) * | 2013-12-16 | 2014-03-19 | 上海证券交易所 | Host group decision system in high availability cluster and switching method for host group decision system |
| CN103970611A (en) * | 2014-05-05 | 2014-08-06 | 神华集团有限责任公司 | Task processing method based on computer cluster |
| CN106330595A (en) * | 2015-07-02 | 2017-01-11 | 阿里巴巴集团控股有限公司 | Heartbeat detection method and apparatus of distributed platform |
| CN105243125A (en) * | 2015-09-29 | 2016-01-13 | 北京京东尚科信息技术有限公司 | PrestoDB cluster running method and apparatus, cluster and data query method and apparatus |
| CN105373431A (en) * | 2015-10-29 | 2016-03-02 | 武汉联影医疗科技有限公司 | Computer system resource management method and computer resource management system |
| CN106851213A (en) * | 2017-03-06 | 2017-06-13 | 深圳市博信诺达经贸咨询有限公司 | The packet method for allocating tasks and system of cloud platform in monitoring system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020042162A1 (en) * | 2018-08-31 | 2020-03-05 | 西门子股份公司 | Control method, device, and system |
| US11574290B2 (en) | 2019-01-23 | 2023-02-07 | Tencent Technology (Shenzhen) Company Limited | Data processing method and apparatus, computer device, and storage medium |
| US11935015B2 (en) | 2019-01-23 | 2024-03-19 | Tencent Technology (Shenzhen) Company Limited | Data processing method and apparatus, computer device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104967635B (en) | Data transmission method and apparatus thereof | |
| US9569399B2 (en) | Routing data communications packets in a parallel computer | |
| CN102307206B (en) | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage | |
| KR101137073B1 (en) | Proactive power management in a parallel computer | |
| US20150269006A1 (en) | Bottleneck detection for performance management | |
| CN105009089B (en) | For promoting the device and method of the management to instruction violation behavior | |
| CN104486234A (en) | Method and server for uninstalling service exchanger to physical network card | |
| CN104636186A (en) | Virtual machine memory management method, physical host, PCIE equipment, configuration method thereof and migration management equipment | |
| CN107370684A (en) | Business current-limiting method and business current-limiting apparatus | |
| CN104636185A (en) | Service context management method, physical host, PCIE equipment and migration management equipment | |
| CN107315697A (en) | Embodied on computer readable storage device, system and method for reducing management port | |
| CN105472291A (en) | Digital video recorder with multiprocessor cluster and realization method of digital video recorder | |
| CN107807608A (en) | Data processing method, data handling system and storage medium | |
| CN108696559B (en) | Stream processing method and device | |
| CN102725735B (en) | Method and system for multithreading collaborative simulations | |
| CN107479870A (en) | A kind of third party's class libraries call method, device, mobile terminal and storage medium | |
| RU2694153C2 (en) | Stream processing using virtual processing agents | |
| US9189370B2 (en) | Smart terminal fuzzing apparatus and method using multi-node structure | |
| CN103514044A (en) | Resource optimization method, device and system of dynamic behavior analysis system | |
| CN111445027A (en) | Training method and device of machine learning model | |
| US9571329B2 (en) | Collective operation management in a parallel computer | |
| CN115392501A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN108205479A (en) | The method, apparatus and storage medium of a kind of faulted-phase judgment | |
| CN113934566A (en) | Exception handling method and device and electronic equipment | |
| CN114218000A (en) | Log management method and device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180316 |