CN104580381A - 一种在多节点网络中执行作业任务的方法 - Google Patents
一种在多节点网络中执行作业任务的方法 Download PDFInfo
- Publication number
- CN104580381A CN104580381A CN201410780849.5A CN201410780849A CN104580381A CN 104580381 A CN104580381 A CN 104580381A CN 201410780849 A CN201410780849 A CN 201410780849A CN 104580381 A CN104580381 A CN 104580381A
- Authority
- CN
- China
- Prior art keywords
- node
- metadata
- task
- grouping
- subjob
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000002123 temporal effect Effects 0.000 claims description 3
- 230000003993 interaction Effects 0.000 abstract 1
- 238000012856 packing Methods 0.000 description 4
- 238000004806 packaging method and process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410780849.5A CN104580381B (zh) | 2014-12-17 | 2014-12-17 | 一种在多节点网络中执行作业任务的方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410780849.5A CN104580381B (zh) | 2014-12-17 | 2014-12-17 | 一种在多节点网络中执行作业任务的方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104580381A true CN104580381A (zh) | 2015-04-29 |
CN104580381B CN104580381B (zh) | 2018-02-06 |
Family
ID=53095539
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410780849.5A Expired - Fee Related CN104580381B (zh) | 2014-12-17 | 2014-12-17 | 一种在多节点网络中执行作业任务的方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104580381B (zh) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105786603A (zh) * | 2016-02-29 | 2016-07-20 | 青岛海尔智能家电科技有限公司 | 一种基于分布式的高并发业务处理系统及方法 |
CN106713504A (zh) * | 2017-02-17 | 2017-05-24 | 平安科技(深圳)有限公司 | 任务处理方法和系统 |
CN106777009A (zh) * | 2016-12-07 | 2017-05-31 | 北京奇虎科技有限公司 | 智能设备及任务计划执行控制方法和装置 |
CN107423188A (zh) * | 2016-03-07 | 2017-12-01 | 阿里巴巴集团控股有限公司 | 日志处理方法及设备 |
CN110753090A (zh) * | 2019-09-20 | 2020-02-04 | 平安普惠企业管理有限公司 | 服务器集群的任务执行方法、装置、计算机设备及存储介质 |
CN113098854A (zh) * | 2021-03-26 | 2021-07-09 | 深信服科技股份有限公司 | 任务编排方法、系统、存储介质和电子设备 |
CN115345728A (zh) * | 2022-08-19 | 2022-11-15 | 中电金信软件有限公司 | 一种结算计息结息的方法及装置 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110173247A1 (en) * | 2000-03-30 | 2011-07-14 | Hubbard Edward A | Massively Distributed Processing System Architecture, Scheduling, Unique Device Identification and Associated Methods |
CN102882981A (zh) * | 2012-10-19 | 2013-01-16 | 南京邮电大学 | 一种对等结构云平台下节点任务的负载均衡方法 |
CN103164261A (zh) * | 2011-12-15 | 2013-06-19 | 中国移动通信集团公司 | 多中心数据任务处理方法、装置及系统 |
CN103188329A (zh) * | 2011-12-31 | 2013-07-03 | 上海伊可夫信息科技有限公司 | 一种实时多任务远程网络控制系统 |
CN104184828A (zh) * | 2014-09-09 | 2014-12-03 | 清华大学 | 混合网络系统、通信方法和网络节点 |
-
2014
- 2014-12-17 CN CN201410780849.5A patent/CN104580381B/zh not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110173247A1 (en) * | 2000-03-30 | 2011-07-14 | Hubbard Edward A | Massively Distributed Processing System Architecture, Scheduling, Unique Device Identification and Associated Methods |
CN103164261A (zh) * | 2011-12-15 | 2013-06-19 | 中国移动通信集团公司 | 多中心数据任务处理方法、装置及系统 |
CN103188329A (zh) * | 2011-12-31 | 2013-07-03 | 上海伊可夫信息科技有限公司 | 一种实时多任务远程网络控制系统 |
CN102882981A (zh) * | 2012-10-19 | 2013-01-16 | 南京邮电大学 | 一种对等结构云平台下节点任务的负载均衡方法 |
CN104184828A (zh) * | 2014-09-09 | 2014-12-03 | 清华大学 | 混合网络系统、通信方法和网络节点 |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105786603A (zh) * | 2016-02-29 | 2016-07-20 | 青岛海尔智能家电科技有限公司 | 一种基于分布式的高并发业务处理系统及方法 |
CN105786603B (zh) * | 2016-02-29 | 2022-03-11 | 青岛海尔智能家电科技有限公司 | 一种基于分布式的高并发业务处理系统及方法 |
CN107423188A (zh) * | 2016-03-07 | 2017-12-01 | 阿里巴巴集团控股有限公司 | 日志处理方法及设备 |
CN107423188B (zh) * | 2016-03-07 | 2021-05-07 | 阿里巴巴集团控股有限公司 | 日志处理方法及设备 |
CN106777009A (zh) * | 2016-12-07 | 2017-05-31 | 北京奇虎科技有限公司 | 智能设备及任务计划执行控制方法和装置 |
CN106777009B (zh) * | 2016-12-07 | 2019-12-13 | 北京安云世纪科技有限公司 | 智能设备及任务计划执行控制方法和装置 |
CN106713504A (zh) * | 2017-02-17 | 2017-05-24 | 平安科技(深圳)有限公司 | 任务处理方法和系统 |
CN106713504B (zh) * | 2017-02-17 | 2018-01-16 | 平安科技(深圳)有限公司 | 任务处理方法和系统 |
CN110753090A (zh) * | 2019-09-20 | 2020-02-04 | 平安普惠企业管理有限公司 | 服务器集群的任务执行方法、装置、计算机设备及存储介质 |
CN113098854A (zh) * | 2021-03-26 | 2021-07-09 | 深信服科技股份有限公司 | 任务编排方法、系统、存储介质和电子设备 |
CN115345728A (zh) * | 2022-08-19 | 2022-11-15 | 中电金信软件有限公司 | 一种结算计息结息的方法及装置 |
CN115345728B (zh) * | 2022-08-19 | 2023-11-03 | 中电金信软件有限公司 | 一种结算计息结息的方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN104580381B (zh) | 2018-02-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104580381A (zh) | 一种在多节点网络中执行作业任务的方法 | |
CN108780386B (zh) | 一种数据存储的方法、装置和系统 | |
US11301154B2 (en) | Distributed storage method and device | |
US10019192B2 (en) | Policy-based hierarchical data protection in distributed storage | |
CN102546782B (zh) | 一种分布式系统及其数据操作方法 | |
US9628438B2 (en) | Consistent ring namespaces facilitating data storage and organization in network infrastructures | |
JP5637552B2 (ja) | ストレージシステム | |
US20150074672A1 (en) | Asynchronous scheduling informed by job characteristics and anticipatory provisioning of data for real-time, parallel processing | |
CN111182067B (zh) | 一种基于星际文件系统ipfs的数据写入方法及设备 | |
US10356150B1 (en) | Automated repartitioning of streaming data | |
CN104050250A (zh) | 一种分布式键-值查询方法和查询引擎系统 | |
US8930501B2 (en) | Distributed data storage system and method | |
EP3180692A1 (en) | Fault tolerant federation of computing clusters | |
CN105335448A (zh) | 基于分布式环境的数据存储及处理系统 | |
CN102591970A (zh) | 一种分布式键-值查询方法和查询引擎系统 | |
CN107450855B (zh) | 一种用于分布式存储的模型可变的数据分布方法及系统 | |
US20130254590A1 (en) | Real time database system | |
CN104166589A (zh) | 一种心跳包的处理方法和装置 | |
US9197546B2 (en) | System and method for providing a messaging cluster with hybrid partitions | |
CN108491163B (zh) | 一种大数据处理方法、装置和存储介质 | |
CN103631894A (zh) | 一种基于hdfs的动态副本管理方法 | |
CN106326239A (zh) | 分布式文件系统及其文件元信息管理方法 | |
Gill et al. | Dynamic cost-aware re-replication and rebalancing strategy in cloud system | |
CN107315745B (zh) | 一种私信存储方法及系统 | |
CN111930716A (zh) | 一种数据库扩容方法、装置及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C41 | Transfer of patent application or patent right or utility model | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20150917 Address after: 225400, room 4, building 401, traffic district, Taixing Town, Taixing, Jiangsu Applicant after: Ju Qiuping Address before: 100020 Beijing city Chaoyang District auspicious A Jiahui International Center No. 14 block 1506 Applicant before: Sea of clouds Science and Technology Ltd. can be thought in Beijing |
|
CB03 | Change of inventor or designer information | ||
CB03 | Change of inventor or designer information |
Inventor after: Mao Gaofeng Inventor before: Xu Lizheng |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20180111 Address after: Room 501, room 2, No. 391, Guiping Road, Xuhui District, Shanghai Applicant after: SHANGHAI CAIYI INFORMATION TECHNOLOGY CO., LTD. Address before: 225400, room 4, building 401, traffic district, Taixing Town, Taixing, Jiangsu Applicant before: Ju Qiuping |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180206 Termination date: 20191217 |