CN110321209A - A kind of task data processing method, device and electronic equipment - Google Patents
A kind of task data processing method, device and electronic equipment Download PDFInfo
- Publication number
- CN110321209A CN110321209A CN201910576590.5A CN201910576590A CN110321209A CN 110321209 A CN110321209 A CN 110321209A CN 201910576590 A CN201910576590 A CN 201910576590A CN 110321209 A CN110321209 A CN 110321209A
- Authority
- CN
- China
- Prior art keywords
- task
- target
- checkpoint
- catalogue
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Retry When Errors Occur (AREA)
Abstract
The embodiment of the present application provides a kind of task data processing method, device and electronic equipment, is related to field of computer technology, and the above method includes: creation target stream task；Goal task catalogue is obtained under default store path；Obtain the target item in goal task catalogue；According to the checkpoint path in target item, obtains target and check point data；Target is loaded by target stream task and checks point data, to restore delay machine stream task.The task data processing method of the embodiment of the present application, by obtaining the target item in delay machine stream task object task list, point data is checked to obtain target, the target checks that point data is the Checkpoint data that delay machine stream task finally stores before delay machine occurs, the intermediate state that stream task can be cut off from this continues to run, and ensure that the consistency of data.
Description
Technical field
This application involves field of computer technology, set more particularly to a kind of task data processing method, device and electronics
It is standby.
Background technique
With the fast development of Internet technology, there are more and more data, so that the processing to data also becomes
It is particularly significant.
The processing of real-time streaming task can be handled as early as possible the data continually to arrive, and the result of processing is opened up as early as possible
Existing feature.Real time data processing is easily lost data after mission failure, therefore streaming computing frame uses Checkpoint
The mode of (checkpoint) improves the reliabilities of data.Specifically, each stream task has one under the external storage of its setting
Independent task list, for storing the Checkpoint data file item that each stream task is most recently successfully.Checkpoint number
According to the storage location for having recorded Checkpoint data in file item.After a stream mission failure, which can be inquired
The task list of itself to obtain Checkpoint data to be restored to the state before mission failure, and continues to run.
Applicants have found that in the prior art, each stream task only can read the task list of itself, therefore,
During flowing task execution, if occurring powering off or the abnormal conditions such as delay machine, in flow-reconstituted task, newly-built stream task be will create
New catalogue, and from starting the process over corresponding task.
Summary of the invention
The embodiment of the present application is designed to provide a kind of task data processing method, device and electronic equipment, to realize
It when flow-reconstituted task, is continued to run from the unfinished state for task of cutting off, ensure that the consistency of data.Specific technical solution is such as
Under:
In a first aspect, the embodiment of the present application discloses a kind of task data processing method, which comprises
Create target stream task；
Goal task catalogue is obtained under default store path；
Obtain the target item in the goal task catalogue；
According to the checkpoint path in the target item, obtains target and check point data；
The target, which is loaded, by the target stream task checks point data.
Optionally, the default store path is checkpoint Checkpoint store path, described in default store path
Lower acquisition goal task catalogue, comprising:
In the Checkpoint store path, each task list is ranked up according to the timestamp of task list；
In task list after sequence, selected in other task objects in addition to the task list of the target stream task
Timestamp and the immediate task list of current time are taken, goal task catalogue is obtained.
Optionally, after the creation target stream task, the method also includes:
When the default store path does not include the goal task catalogue, task is handled by the target stream task
Data.
Optionally, the target item obtained in the goal task catalogue, comprising:
The maximum Checkpoint data file item of Checkpoint ID in the goal task catalogue is obtained, mesh is obtained
Mark item.
Second aspect, the embodiment of the present application provide a kind of task data processing unit, and described device includes:
Task creation module is flowed, for creating target stream task；
Target directory obtains module, for obtaining goal task catalogue under default store path；
Target item obtains module, for obtaining the target item in the goal task catalogue；
Checkpoint data acquisition module, for obtaining target inspection points according to the checkpoint path in the target item
According to；
Task recovery module is flowed, checks point data for loading the target by the target stream task.
Optionally, the default store path is checkpoint Checkpoint store path, and the target directory obtains mould
Block, comprising:
Directory sorting submodule is used in the Checkpoint store path, according to the timestamp pair of task list
Each task list is ranked up；
Timestamp judging submodule, in the task list after sequence, in the task mesh for removing the target stream task
Access time stamp and the immediate task list of current time, obtain goal task catalogue in other task objects outside record.
Optionally, described device further include:
Task creates module, for when the default store path does not include the goal task catalogue, by described
Target stream task handles task data.
Optionally, the target item obtains module, is specifically used for:
The maximum Checkpoint data file item of Checkpoint ID in the goal task catalogue is obtained, mesh is obtained
Mark item.
The third aspect, the embodiment of the present application disclose a kind of electronic equipment, including processor, communication interface, memory and
Communication bus, wherein the processor, the communication interface, the memory are completed each other by the communication bus
Communication；
The memory, for storing computer program；
The processor when for executing the program stored on the memory, realizes any institute of above-mentioned first aspect
The task data processing method stated.
Fourth aspect, the embodiment of the present application disclose a kind of computer readable storage medium, the computer-readable storage
Dielectric memory contains computer program, when the computer program is executed by processor, realizes that above-mentioned first aspect is any described
Task data processing method.
5th aspect, the embodiment of the present application also provides a kind of computer program products comprising instruction, when it is being calculated
When running on machine, any task data processing method of above-mentioned first aspect is realized.
In a kind of task data processing method provided by the embodiments of the present application, device and electronic equipment, specifically: creation
Target stream task；Goal task catalogue is obtained under default store path；Obtain the target item in goal task catalogue；According to mesh
The checkpoint path in item is marked, target is obtained and checks point data；Target is loaded by target stream task and checks point data, to restore
Delay machine stream task.In the embodiment of the present application, by obtaining the target item in delay machine stream task object task list, to obtain mesh
Mark checks that point data, the target check that point data is the Checkpoint (inspection that delay machine stream task finally stores before delay machine occurs
Make an inventory of) data, restore stream task since the target checks point data, from the beginning avoiding stream task newly-built in the prior art can be
Start to process interrupt task.Therefore, the embodiment of the present application is in task recovery, can be cut off from this intermediate state of stream task after
Reforwarding row ensure that the consistency of data.Certainly, implement the application any product or method it is not absolutely required to and meanwhile reach
All the above advantage.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the first schematic diagram of the task data processing method of the embodiment of the present application；
Fig. 2 is second of schematic diagram of the task data processing method of the embodiment of the present application；
Fig. 3 is the third schematic diagram of the task data processing method of the embodiment of the present application；
Fig. 4 is the 4th kind of schematic diagram of the task data processing method of the embodiment of the present application；
Fig. 5 is a kind of schematic diagram of the task data processing unit of the embodiment of the present application；
Fig. 6 is a kind of schematic diagram of the electronic equipment of the embodiment of the present application；
Fig. 7 is the default schematic diagram for depositing task list under path of the embodiment of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application is described.
In a first aspect, the embodiment of the present application discloses a kind of task data processing method, as shown in Figure 1.Fig. 1 is the application
A kind of task data processing method flow chart of embodiment, which comprises
S101 creates target stream task.
The task data processing method of the embodiment of the present application can be realized by electronic equipment, specifically, the electronic equipment
It can be the server based on streaming computing frame.Target stream task can be any stream task, and creation target stream task can be with
To create a stream task under normal circumstances, or stream task delay machine, mechanical recovery normally create a stream task afterwards.?
In a kind of possible embodiment can it is each create a stream task when, the equal number of tasks of triggering execution the embodiment of the present application
According to processing method.Wherein, stream task delay machine refers to since power-off or crash stream task can not continue to run, and must weigh
The scene newly started.
Optionally, referring to fig. 2, after creating target stream task, the above method further include:
S106, when above-mentioned default store path does not include above-mentioned goal task catalogue, at above-mentioned target stream task
Manage task data.
For example, sentencing when not including other task objects in addition to the task list of target stream task in default store path
Fixed does not include goal task catalogue.Goal task catalogue if it does not exist, then it represents that the also following anxious generation of delay machine stream task
Checkpoint data, just delay machine, or stream task is not present before, it is therefore desirable to target stream task restarts new
Task can also establish the task list of target stream task in external storage at this time.
S102 obtains goal task catalogue under default store path.
In the Checkpoint function based on streaming computing frame, each task list for flowing task is stored in one and deposits
It stores up under path (i.e. default storage road), each stream task has an independent task list, and electronic equipment is searched delay machine stream and appointed
The path of the external storage of business obtains the goal task catalogue of delay machine stream task under the path.Wherein, goal task catalogue is
Last modification time and the immediate task mould catalogue of current time in addition to the task list of target stream task.
In a kind of possible embodiment, presetting store path is checkpoint Checkpoint store path, referring to
Fig. 3, it is above-mentioned to obtain goal task catalogue under default store path, comprising:
S1021, in the Checkpoint store path of above-mentioned delay machine stream task, according to the timestamp of task list to each
Task list is ranked up.
The path Checkpoint in the external storage of setting, according to the timestamp of each task object (when final updating
Between), task list each in the path is ranked up.
S1022, in the task list after sequence, in other task mesh in addition to the task list of above-mentioned target stream task
Access time stamp and the immediate catalogue of current time, obtain goal task catalogue in mark.
In task list after sequence, the task list of target stream task is filtered out, then access time stamp is closest
The task list of current time obtains goal task catalogue.
S103 obtains the target item in above-mentioned goal task catalogue.
Target item is the Checkpoint data file item of the last one storage in goal task catalogue.
A kind of target item in possible embodiment, in the above-mentioned above-mentioned goal task catalogue of acquisition, comprising:
The maximum Checkpoint data file item of Checkpoint ID in above-mentioned goal task catalogue is obtained, mesh is obtained
Mark item.
S104 obtains target and checks point data according to the checkpoint path in above-mentioned target item.
The store path that Checkpoint data are had recorded in target item stores road according to the storage of Checkpoint data
Diameter obtains Checkpoint data, obtains target and checks point data.
Specifically, the relationship of default store path, task list and Checkpoint data file item can be such as Fig. 7 institute
Show, is stored with task list under default store path, includes Checkpoint data file item in task list.
S105 loads above-mentioned target by above-mentioned target stream task and checks point data.
Stream task can save completed Task Progress based on Checkpoint function, at one during execution
After stream task delay machine, target stream task is created, above-mentioned target is loaded by target stream task and checks point data, to restore the delay machine
Stream task Task Progress.
Target stream task checks that point data restores the process of delay machine stream task using target, and utilizes in the related technology
The process that Checkpoint data restore stream task is identical, and details are not described herein again.
In a kind of task data processing method provided by the embodiments of the present application, passes through and obtain delay machine stream task object task
Target item in catalogue, so that obtaining target checks that point data, the target check that point data is delay machine stream times before delay machine occurs
The Checkpoint data that business finally stores are restored stream task since the target checks point data, are avoided in the prior art
Newly-built stream task can handle interrupt task from the beginning.Therefore, the embodiment of the present application can be cut off in task recovery from this
The intermediate state of stream task continues to run, and ensure that the consistency of data.
In a kind of embodiment of the application task data processing method, disclosed to better illustrate the embodiment of the present application
A kind of task data processing method, can have a kind of task data processing method flow chart of the embodiment of the present application shown in Fig. 4.
S401 creates target stream task, obtains default store path.
Default store path is in the Checkpoint function based on streaming computing frame, for storing the task of stream task
The path of catalogue.
S402 sorts to the task list under default store path.
Each task list under default store path is ranked up according to timestamp.
S403 judges whether there is goal task catalogue；If it exists, S404 is executed, if it does not exist, executes S406.
Judge default store path with the presence or absence of the task list in addition to the task list of target stream task, and if it exists, i.e.
There are goal task catalogues.
S404 obtains the Checkpoint data file item of maximum Checkpoint ID catalogue under goal task catalogue, presses
Target Checkpoint data are obtained according to the checkpoint path in this Checkpoint data file item.
S405 restores target Checkpoint data.
Target Checkpoint data are loaded using target stream task, to restore the Task Progress of the stream task of delay machine.
S406 runs new task.
Goal task catalogue if it does not exist, then it represents that the also following anxious generation Checkpoint data of delay machine stream task, just
Delay machine, or stream task is not present before, it is therefore desirable to target stream task restarts corresponding task, at this time can be
The task list of target stream task is established in external storage.
In the embodiment of the present application, by obtaining the target item in delay machine stream task object task list, to obtain target
Check that point data, the target check that point data is the Checkpoint data that delay machine stream task finally stores before delay machine occurs,
Restore stream task since the target checks point data, avoids during in the prior art newly-built stream task can handle from the beginning
Disconnected task.Therefore, in task recovery, the intermediate state that stream task can be cut off from this continues to run the embodiment of the present application, protects
The consistency of data is demonstrate,proved.
The embodiment of the present application discloses a kind of task data processing unit, as shown in Figure 5.Fig. 5 is the embodiment of the present application
A kind of task data processing device structure diagram, above-mentioned apparatus include:
Task creation module 501 is flowed, for creating target stream task；
Target directory obtains module 502, for obtaining goal task catalogue under default store path；
Target item obtains module 503, for obtaining the target item in above-mentioned goal task catalogue；
Checkpoint data acquisition module 504, for obtaining target checkpoint according to the checkpoint path in above-mentioned target item
Data；
Task recovery module 505 is flowed, checks point data for loading above-mentioned target by above-mentioned target stream task.
Optionally, above-mentioned default store path is checkpoint Checkpoint store path, and above-mentioned target directory obtains mould
Block 502, comprising:
Directory sorting submodule is used in above-mentioned Checkpoint store path, according to the timestamp pair of task list
Each task list is ranked up；
Timestamp judging submodule, in the task list after sequence, in the task mesh for removing above-mentioned target stream task
Access time stamp and the immediate task list of current time, obtain goal task catalogue in other task objects outside record.
Optionally, the task data processing unit of the embodiment of the present application further include:
Task creates module, for when above-mentioned default store path does not include above-mentioned goal task catalogue, by above-mentioned
Target stream task handles task data.
Optionally, above-mentioned target item obtains module 503, is specifically used for:
The maximum Checkpoint data file item of Checkpoint ID in above-mentioned goal task catalogue is obtained, mesh is obtained
Mark item.
Another aspect, the embodiment of the present application disclose a kind of electronic equipment, as shown in Figure 6.Fig. 6 is the embodiment of the present application
A kind of electronic equipment structural schematic diagram, including processor 601, communication interface 602, memory 603 and communication bus 604, wherein
Above-mentioned processor 601, above-mentioned communication interface 602, above-mentioned memory 603 complete mutual lead to by above-mentioned communication bus 604
Letter；
Above-mentioned memory 603, for storing computer program；
Above-mentioned processor 601 when for executing the program stored on above-mentioned memory 603, realizes following methods step:
Create target stream task；
Goal task catalogue is obtained under default store path；
Obtain the target item in above-mentioned goal task catalogue；
According to the checkpoint path in above-mentioned target item, obtains target and check point data；
Above-mentioned target, which is loaded, by above-mentioned target stream task checks point data.
In the electronic equipment of the embodiment of the present application, by obtaining the target item in delay machine stream task object task list,
Point data is checked to obtain target, and delay machine stream task finally stores before target inspection point data as generation delay machine
Checkpoint (checkpoint) data restore stream task since the target checks point data, avoid and create in the prior art
Stream task can handle interrupt task from the beginning.Therefore, the embodiment of the present application can cut off stream from this and appoint in task recovery
The intermediate state of business continues to run, and ensure that the consistency of data.
Optionally, processor 601 is for that can also realize any of the above-described when executing the program stored on memory 603
Task data processing method.
The communication bus 604 that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral
Component Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus 604 can be divided into address bus, data/address bus, control bus etc..For
Convenient for indicating, only indicated with a thick line in figure, it is not intended that an only bus or a type of bus.
Communication interface 602 is for the communication between above-mentioned electronic equipment and other equipment.
Memory 603 may include random access memory (Random Access Memory, RAM), also may include
Nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory
603 can also be that at least one is located remotely from the storage device of aforementioned processor 601.
Above-mentioned processor 601 can be general processor, including central processing unit (Central Processing
Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital
Signal Processing, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components.
Another aspect, the embodiment of the present application disclose a kind of computer readable storage medium, the computer-readable storage
Dielectric memory contains computer program, when the computer program is executed by processor, realizes above-mentioned task data processing method
In any method and step.
In a kind of computer readable storage medium provided by the embodiments of the present application, passes through and obtain delay machine stream task object and appoint
Target item in catalogue of being engaged in, so that obtaining target checks that point data, the target check that point data is that delay machine stream before delay machine occurs
Checkpoint (checkpoint) data that task finally stores are restored stream task since the target checks point data, are avoided
Newly-built stream task can handle interrupt task from the beginning in the prior art.Therefore, the embodiment of the present application is in task recovery, energy
It is enough to be continued to run from the intermediate state for cutting off stream task, it ensure that the consistency of data.
Another aspect, the embodiment of the present application also provides a kind of computer program products comprising instruction, when it is being calculated
When running on machine, any method and step in above-mentioned task data processing method is realized.
In a kind of computer program product comprising instruction provided by the embodiments of the present application, passes through and obtain delay machine stream task
Target item in goal task catalogue, so that obtaining target checks that point data, the target check that point data is before delay machine occurs
Checkpoint (checkpoint) data that delay machine stream task finally stores restore stream task since the target checks point data,
Interrupt task can be handled from the beginning by avoiding stream task newly-built in the prior art.Therefore, the embodiment of the present application is extensive in task
When multiple, the intermediate state that stream task can be cut off from this is continued to run, and ensure that the consistency of data.
Another aspect, the embodiment of the present application also provides a kind of computer program products comprising instruction, when it is being calculated
When being run on machine, so that computer executes any task data processing method in above-described embodiment.
In a kind of computer program product comprising instruction provided by the embodiments of the present application, passes through and obtain delay machine stream task
Target item in goal task catalogue, so that obtaining target checks that point data, the target check that point data is before delay machine occurs
Checkpoint (checkpoint) data that delay machine stream task finally stores restore stream task since the target checks point data,
Interrupt task can be handled from the beginning by avoiding stream task newly-built in the prior art.Therefore, the embodiment of the present application is extensive in task
When multiple, the intermediate state that stream task can be cut off from this is continued to run, and ensure that the consistency of data.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or
It partly generates according to process or function described in the embodiment of the present application.The computer can be general purpose computer, dedicated meter
Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk
Solid State Disk (SSD)) etc..
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device,
For electronic equipment and storage medium embodiment, since it is substantially similar to the method embodiment, so being described relatively simple, phase
Place is closed to illustrate referring to the part of embodiment of the method.
The foregoing is merely the preferred embodiments of the application, are not intended to limit the protection scope of the application.It is all
Any modification, equivalent replacement, improvement and so within spirit herein and principle are all contained in the protection scope of the application
It is interior.
Claims (10)
1. a kind of task data processing method, which is characterized in that the described method includes:
Create target stream task；
Goal task catalogue is obtained under default store path；
Obtain the target item in the goal task catalogue；
According to the checkpoint path in the target item, obtains target and check point data；
The target, which is loaded, by the target stream task checks point data.
2. the method according to claim 1, wherein the default store path is that checkpoint Checkpoint is deposited
Path is stored up, it is described to obtain goal task catalogue under default store path, comprising:
In the Checkpoint store path, each task list is ranked up according to the timestamp of task list；
In task list after sequence, when being chosen in other task objects in addition to the task list of the target stream task
Between stamp with the immediate task list of current time, obtain goal task catalogue.
3. the method according to claim 1, wherein the method is also after the creation target stream task
Include:
When the default store path does not include the goal task catalogue, number of tasks is handled by the target stream task
According to.
4. the method according to claim 1, wherein the target item obtained in the goal task catalogue,
Include:
The maximum Checkpoint data file item of Checkpoint ID in the goal task catalogue is obtained, target item is obtained.
5. a kind of task data processing unit, which is characterized in that described device includes:
Task creation module is flowed, for creating target stream task；
Target directory obtains module, for obtaining goal task catalogue under default store path；
Target item obtains module, for obtaining the target item in the goal task catalogue；
Checkpoint data acquisition module, for obtaining target and checking point data according to the checkpoint path in the target item；
Task recovery module is flowed, checks point data for loading the target by the target stream task.
6. device according to claim 5, which is characterized in that the default store path is that checkpoint Checkpoint is deposited
Path is stored up, the target directory obtains module, comprising:
Directory sorting submodule is used in the Checkpoint store path, according to the timestamp of task list to each
Business catalogue is ranked up；
Timestamp judging submodule, in the task list after sequence, in addition to the task list of the target stream task
Other task objects in access time stamp and current time closest to the catalogue of task, obtain goal task catalogue.
7. device according to claim 6, which is characterized in that described device further include:
Task creates module, for passing through the target when the default store path does not include the goal task catalogue
Stream task handles task data.
8. device according to claim 5, which is characterized in that the target item obtains module, is specifically used for:
The maximum Checkpoint data file of Checkpoint ID in the goal task catalogue is obtained, target item is obtained.
9. a kind of electronic equipment, which is characterized in that including processor, communication interface, memory and communication bus, wherein described
Processor, the communication interface, the memory complete mutual communication by the communication bus；
The memory, for storing computer program；
The processor when for executing the program stored on the memory, realizes any side claim 1-4
Method step.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program realizes claim 1-4 any method and step when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910576590.5A CN110321209A (en) | 2019-06-28 | 2019-06-28 | A kind of task data processing method, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910576590.5A CN110321209A (en) | 2019-06-28 | 2019-06-28 | A kind of task data processing method, device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110321209A true CN110321209A (en) | 2019-10-11 |
Family
ID=68120585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910576590.5A Pending CN110321209A (en) | 2019-06-28 | 2019-06-28 | A kind of task data processing method, device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110321209A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411520A (en) * | 2011-09-21 | 2012-04-11 | 电子科技大学 | Data-unit-based disaster recovery method for seismic data |
| US20140164829A1 (en) * | 2012-12-10 | 2014-06-12 | International Business Machines Corporation | Recovery for long running multithreaded processes |
| CN105955820A (en) * | 2016-04-20 | 2016-09-21 | 北京云宏信达信息科技有限公司 | Method, device, and system for job stream control |
| CN108228328A (en) * | 2018-01-05 | 2018-06-29 | 北京奇艺世纪科技有限公司 | A kind of stream task implementation method, device and electronic equipment |
| US20180329779A1 (en) * | 2014-06-12 | 2018-11-15 | International Business Machines Corporation | Checkpoint triggering in a computer system |
| CN109426550A (en) * | 2017-08-23 | 2019-03-05 | 阿里巴巴集团控股有限公司 | The dispatching method and equipment of resource |
-
2019
- 2019-06-28 CN CN201910576590.5A patent/CN110321209A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411520A (en) * | 2011-09-21 | 2012-04-11 | 电子科技大学 | Data-unit-based disaster recovery method for seismic data |
| US20140164829A1 (en) * | 2012-12-10 | 2014-06-12 | International Business Machines Corporation | Recovery for long running multithreaded processes |
| US20180329779A1 (en) * | 2014-06-12 | 2018-11-15 | International Business Machines Corporation | Checkpoint triggering in a computer system |
| CN105955820A (en) * | 2016-04-20 | 2016-09-21 | 北京云宏信达信息科技有限公司 | Method, device, and system for job stream control |
| CN109426550A (en) * | 2017-08-23 | 2019-03-05 | 阿里巴巴集团控股有限公司 | The dispatching method and equipment of resource |
| CN108228328A (en) * | 2018-01-05 | 2018-06-29 | 北京奇艺世纪科技有限公司 | A kind of stream task implementation method, device and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 大数据星球-浪尖: "必会:关于SparkStreaming checkpoint那些事儿", 《HTTPS://BLOG.CSDN.NET/RLNLO2PNEFX9C/ARTICLE/DETAILS/81417061》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109240886B (en) | Exception handling method, exception handling device, computer equipment and storage medium | |
| CN107025153B (en) | Disk failure prediction method and device | |
| CN112131071B (en) | Memory evaluation method and device | |
| CN106294073B (en) | Service calling method and device | |
| US20080229262A1 (en) | Design rule management method, design rule management program, rule management apparatus and rule verification apparatus | |
| CN110413432B (en) | Information processing method, electronic equipment and storage medium | |
| JP5200970B2 (en) | Quality control system, quality control device and quality control program | |
| CN108255620A (en) | A kind of business logic processing method, apparatus, service server and system | |
| CN103995715A (en) | Application program repairing method and device and server | |
| JP2007323193A (en) | System, method and program for detecting abnormality of performance load | |
| CN106155806A (en) | A kind of multi-task scheduling method and server | |
| CN108416449A (en) | A kind of O＆M method and apparatus | |
| CN107943603A (en) | A kind of method for detecting operation state, detection circuit and electronic equipment | |
| WO2021157299A1 (en) | Communication device, surveillance server, and log collection method | |
| CN108400893A (en) | Processing method, device and the electronic equipment of journal file | |
| CN105930537A (en) | Page storing method and electronic equipment | |
| US8245085B2 (en) | Dump output control apparatus and dump output control method | |
| CN110309016A (en) | A kind of fusing restoration methods, device and server | |
| CN110427259A (en) | A kind of task processing method and device | |
| CN108153654A (en) | A kind of log collecting method and device | |
| CN104239091A (en) | File cleaning method and device and terminal | |
| KR20220000880A (en) | Systems and methods for centralization of server initialization information | |
| CN106776728A (en) | Code check method, system and development platform based on log file analysis | |
| US11354113B1 (en) | Reliable deployment of upgrade events for a service based on predefined rollout policies | |
| CN115729727A (en) | Fault repairing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191011 |