JP4308241B2 - ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム - Google Patents
ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム Download PDFInfo
- Publication number
- JP4308241B2 JP4308241B2 JP2006305614A JP2006305614A JP4308241B2 JP 4308241 B2 JP4308241 B2 JP 4308241B2 JP 2006305614 A JP2006305614 A JP 2006305614A JP 2006305614 A JP2006305614 A JP 2006305614A JP 4308241 B2 JP4308241 B2 JP 4308241B2
- Authority
- JP
- Japan
- Prior art keywords
- task
- job
- computer
- processing
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5066—Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/506—Constraint
Description
(1) ジョブ全体を1つのノードに送り、1つのタスクとして実行を開始する。
(2) ノードでのタスク処理において、実行終了希望時刻(デッドライン)やリソース使用コスト(課金)等の要求項目(SLA/SLO)に対して結果的に違反しそうな状況であると判定されたとき、実行中のタスクを一時的に中断する。
(3) ジョブデータの範囲を分ける等の処理により、タスクを分割する。
(4) 処理タスクを残して、それ以外の分割タスクを他のノードに移動する。
(5) 処理タスク及び分割タスクをそれぞれ再開あるいは開始する。
(6) 各ノードにおいて、(2) から (5) の手順を繰り返す。
- ジョブに関するSLO、例えば、実行終了希望時刻(デッドライン)。
- アプリケーションに固有のパラメータ等を記述している入力ファイル。
- ジョブを最初に投入した(木構造の根の部分となる)ノードのID。
また、ノードのジョブ実行状況管理テーブルは、次の項目を含む。
- ノードID。
- 終了ジョブ割合。
- リソース使用率。
- 処理すべきタスクの一部を移動させた移動先ノードリスト。
TE=T1+T2
T1=TSI+TSO+T2/r より
T1=TE/(1+r) + r(TSI+TSO)/(1+r)
T2=rTE/(1+r) − r(TSI+TSO)/(1+r)
TR=(TE−TSI−TSO)r/(1+r) −TD−TM >sTE
110 センター・コンソール
111 処理装置
114 記憶装置
115 実行情報管理部
120 ノード
121 処理装置
122 メモリ装置
123 記憶装置
125 実行管理部
126 実行アダプタ部
127 拡張アプリケーション部
430 拡張部
431 分割処理部
432 マージ処理部
433 進捗監視部
434 フック用ライブラリ
435 分割判定部
445 タスク移動処理部
455 タスク終了監視部
Claims (7)
- ネットワーク接続された複数のコンピュータで任意のタスク数に分割可能なジョブを実行するジョブ実行方法であって、
前記複数のコンピュータの中の1つのコンピュータに前記ジョブを提供して、前記1つのコンピュータで前記ジョブのタスクを所定時間処理し、
前記1つのコンピュータの処理装置により、前記所定時間におけるタスク処理の進捗率を算出して前記進捗率及び前記所定時間に基づき前記1つのコンピュータでのタスク処理の完了時間を推定し、
前記処理装置により、前記推定した完了時間が前記ジョブの要求項目を満たすか否かを判定し、
前記推定した完了時間が前記要求項目を満たす場合には、前記1つのコンピュータにおける前記ジョブのタスクを前記1つのコンピュータで処理して結果を生成し、
前記推定した完了時間が前記要求項目を満たさない場合には、前記処理装置により、前記1つのコンピュータにおける前記ジョブのタスクを前記1つのコンピュータに残すタスクと前記複数のコンピュータの中の他のコンピュータに移動するタスクとに分割し、
残した前記ジョブのタスクを前記1つのコンピュータで更に所定時間処理すると共、前記処理装置により、前記移動するタスクを前記他のコンピュータに移動して処理させ、
前記移動して処理させるタスクについても、前記他のコンピュータにより、前記進捗率及び前記所定時間に基づく前記他のコンピュータでのタスク処理の完了時間を推定し、当該完了時間が前記要求項目を満たすか否かを判定し、当該完了時間が前記要求項目を満たす場合には、前記他のコンピュータで処理して結果を生成し、当該完了時間が前記要求項目を満たさない場合には、前記他のコンピュータに残すタスクと前記複数のコンピュータの中の更に他のコンピュータに移動するタスクとに分割し、当該残したタスクを前記他のコンピュータで更に所定時間処理すると共、当該移動するタスクを前記更に他のコンピュータに移動して処理させることを、移動して処理させるコンピュータでのタスク処理の推定した完了時間が前記要求項目を満たすまで、繰り返し、
前記タスクを移動したコンピュータにより、前記移動して処理させたタスクの結果を前記処理させたコンピュータから取得して前記取得した結果と前記タスクを移動したコンピュータで更に所定時間処理したタスクの結果とをマージすることを、前記他のコンピュータに戻るまで繰り返し、
前記処理装置により、前記他のコンピュータから前記移動して処理させたタスクの結果を取得して前記取得した結果と前記1つのコンピュータで更に所定時間処理したタスクの結果とをマージする、
ことを含む前記ジョブ実行方法。 - 前記進捗率を算出することが、前記処理装置により、処理したタスク数を監視及び計数して前記ジョブの処理すべきタスク数に対する比率を計算することを含む、請求項1に記載のジョブ実行方法。
- 前記タスク処理の完了時間を推定することが、前記処理装置により、前記完了時間をTEとし、前記所定時間をTとし、前記進捗率をpとして、TE=T(1−p)/pを計算することを含む、請求項1又は2に記載のジョブ実行方法。
- 前記推定した完了時間が前記ジョブの要求項目を満たすか否かを判定することが、前記要求項目を前記ジョブのデッドライン時刻(実行終了希望時刻)として、前記処理装置により、前記デッドライン時刻までの残余時間が前記推定した完了時間よりも長いか否かを判定することを含む、請求項1に記載のジョブ実行方法。
- 前記推定した完了時間が前記ジョブの要求項目を満たすか否かを判定することが、前記要求項目を前記コンピュータの使用コスト(課金)から定まる前記ジョブについて前記コンピュータを使用できる使用可能時間として、前記処理装置により、前記使用可能時間が前記推定した完了時間よりも長いか否かを判定することを含む、請求項1に記載のジョブ実行方法。
- 前記他のコンピュータとして前記複数のコンピュータの中のリソース使用率が低いコンピュータを選択して、前記リソース使用率が低いコンピュータに前記移動するタスクを移動して処理させることを含む、請求項1に記載のジョブ実行方法。
- 前記1つのコンピュータに前記ジョブを提供することが、前記複数のコンピュータに接続されたセンター・コンソールから前記1つのコンピュータに前記ジョブを提供することを含み、前記移動するタスクを前記他のコンピュータに移動して処理させることが、前記センター・コンソールが選択した前記他のコンピュータに前記移動するタスクを移動して処理させることを含み、前記センター・コンソールが前記1つのコンピュータでマージした結果を前記ジョブの結果として受け取る、請求項1に記載のジョブ実行方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006305614A JP4308241B2 (ja) | 2006-11-10 | 2006-11-10 | ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム |
US11/933,725 US8219997B2 (en) | 2006-11-10 | 2007-11-01 | Execution the job that is divided into job tasks based on the estimated completion time |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006305614A JP4308241B2 (ja) | 2006-11-10 | 2006-11-10 | ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2008123205A JP2008123205A (ja) | 2008-05-29 |
JP4308241B2 true JP4308241B2 (ja) | 2009-08-05 |
Family
ID=39370692
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2006305614A Expired - Fee Related JP4308241B2 (ja) | 2006-11-10 | 2006-11-10 | ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム |
Country Status (2)
Country | Link |
---|---|
US (1) | US8219997B2 (ja) |
JP (1) | JP4308241B2 (ja) |
Families Citing this family (143)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010012122A1 (en) * | 2008-07-29 | 2010-02-04 | Lucent Technologies Inc. | The method and apparatus for the resource sharing between user devices in computer network |
US8312037B1 (en) * | 2008-08-28 | 2012-11-13 | Amazon Technologies, Inc. | Dynamic tree determination for data processing |
US9002721B2 (en) * | 2008-10-08 | 2015-04-07 | Appirio, Inc. | System and method for project management and completion |
US8671412B2 (en) * | 2008-10-24 | 2014-03-11 | International Business Machines Corporation | Calculating and communicating level of carbon offsetting required to compensate for performing a computing task |
US7587718B1 (en) * | 2008-10-31 | 2009-09-08 | Synopsys, Inc. | Method and apparatus for enforcing a resource-usage policy in a compute farm |
US8819106B1 (en) | 2008-12-12 | 2014-08-26 | Amazon Technologies, Inc. | Managing distributed execution of programs |
US8370493B2 (en) * | 2008-12-12 | 2013-02-05 | Amazon Technologies, Inc. | Saving program execution state |
US8621476B2 (en) * | 2008-12-15 | 2013-12-31 | Korea Advanced Institute Of Science And Technology | Method and apparatus for resource management in grid computing systems |
EP2370904A4 (en) * | 2008-12-26 | 2012-07-04 | Mimos Berhad | METHOD FOR MANAGING CALCULATION RESOURCES VIA A NETWORK |
US8296419B1 (en) | 2009-03-31 | 2012-10-23 | Amazon Technologies, Inc. | Dynamically modifying a cluster of computing nodes used for distributed execution of a program |
US9569270B2 (en) | 2009-04-21 | 2017-02-14 | Empire Technology Development Llc | Mapping thread phases onto heterogeneous cores based on execution characteristics and cache line eviction counts |
US9189282B2 (en) | 2009-04-21 | 2015-11-17 | Empire Technology Development Llc | Thread-to-core mapping based on thread deadline, thread demand, and hardware characteristics data collected by a performance counter |
US8881157B2 (en) * | 2009-09-11 | 2014-11-04 | Empire Technology Development Llc | Allocating threads to cores based on threads falling behind thread completion target deadline |
US8190744B2 (en) * | 2009-05-28 | 2012-05-29 | Palo Alto Research Center Incorporated | Data center batch job quality of service control |
JP5377093B2 (ja) * | 2009-06-08 | 2013-12-25 | 三菱電機株式会社 | 計算機システム、計算機リソース制御方法および計算機リソース制御プログラム |
US8479215B2 (en) * | 2009-08-18 | 2013-07-02 | International Business Machines Corporation | Decentralized load distribution to reduce power and/or cooling costs in an event-driven system |
US20120173604A1 (en) * | 2009-09-18 | 2012-07-05 | Nec Corporation | Data center system, reconfigurable node, reconfigurable node controlling method and reconfigurable node control program |
JP5036791B2 (ja) * | 2009-11-19 | 2012-09-26 | Necアクセステクニカ株式会社 | データ処理システム、データ処理方法およびデータ処理プログラム |
GB2475897A (en) * | 2009-12-04 | 2011-06-08 | Creme Software Ltd | Resource allocation using estimated time to complete jobs in a grid or cloud computing environment |
JP2011123817A (ja) * | 2009-12-14 | 2011-06-23 | Fujitsu Ltd | ジョブ振分装置、ジョブ振分プログラム及びジョブ振分方法 |
KR101644800B1 (ko) * | 2010-01-07 | 2016-08-02 | 삼성전자주식회사 | 컴퓨팅 시스템 및 방법 |
US9319281B2 (en) | 2010-05-14 | 2016-04-19 | Hitachi, Ltd. | Resource management method, resource management device, and program product |
JP5465105B2 (ja) * | 2010-06-21 | 2014-04-09 | 三菱電機株式会社 | 計算機システム及びコンピュータプログラム及びパイプライン処理方法 |
WO2012027478A1 (en) | 2010-08-24 | 2012-03-01 | Jay Moorthi | Method and apparatus for clearing cloud compute demand |
US8640137B1 (en) | 2010-08-30 | 2014-01-28 | Adobe Systems Incorporated | Methods and apparatus for resource management in cluster computing |
CN102033777B (zh) * | 2010-09-17 | 2013-03-20 | 中国资源卫星应用中心 | 基于ice的分布式作业调度引擎 |
US8479204B1 (en) * | 2010-09-30 | 2013-07-02 | Emc Corporation | Techniques for determining transaction progress |
US8375389B2 (en) * | 2010-10-20 | 2013-02-12 | Microsoft Corporation | Ordered scheduling of suspended processes based on resumption events |
US8812677B2 (en) * | 2010-12-21 | 2014-08-19 | Hitachi, Ltd. | Data processing method and apparatus for remote storage system |
US8892960B2 (en) | 2011-01-19 | 2014-11-18 | Oracle International Corporation | System and method for determining causes of performance problems within middleware systems |
US8631280B2 (en) * | 2011-01-19 | 2014-01-14 | Oracle International Corporation | Method of measuring and diagnosing misbehaviors of software components and resources |
US8600725B2 (en) | 2011-01-19 | 2013-12-03 | Oracle International Corporation | System and method for providing a static model map of behaviors in a middleware system, for use in identifying system problems |
US8627150B2 (en) | 2011-01-19 | 2014-01-07 | Oracle International Corporation | System and method for using dependency in a dynamic model to relate performance problems in a complex middleware environment |
US9600523B2 (en) | 2011-01-19 | 2017-03-21 | Oracle International Corporation | Efficient data collection mechanism in middleware runtime environment |
US20120192200A1 (en) * | 2011-01-21 | 2012-07-26 | Rao Jayanth N | Load Balancing in Heterogeneous Computing Environments |
US8935318B1 (en) * | 2011-03-28 | 2015-01-13 | Google Inc. | Opportunistic job processing in a distributed computer environment |
TWI561995B (en) * | 2011-04-26 | 2016-12-11 | Intel Corp | Load balancing in heterogeneous computing environments |
US8612580B2 (en) * | 2011-05-31 | 2013-12-17 | Microsoft Corporation | Distributed computing framework |
EP2541408B1 (en) * | 2011-06-28 | 2020-10-07 | Amadeus S.A.S. | Method and system for processing data for database modification |
US8601473B1 (en) | 2011-08-10 | 2013-12-03 | Nutanix, Inc. | Architecture for managing I/O and storage for a virtualization environment |
JP2013061845A (ja) * | 2011-09-14 | 2013-04-04 | Ricoh Co Ltd | 携帯機器及びその制御方法 |
US8904397B2 (en) * | 2011-10-31 | 2014-12-02 | International Business Machines Corporation | Staggering execution of scheduled tasks based on behavioral information |
US9047396B2 (en) | 2011-10-31 | 2015-06-02 | International Business Machines Corporation | Method, system and computer product for rescheduling processing of set of work items based on historical trend of execution time |
US9355009B2 (en) * | 2011-10-31 | 2016-05-31 | International Business Machines Corporation | Performance of scheduled tasks via behavior analysis and dynamic optimization |
US9430286B2 (en) * | 2011-12-12 | 2016-08-30 | International Business Machines Corporation | Authorizing distributed task processing in a distributed storage network |
US20180083930A1 (en) * | 2011-12-12 | 2018-03-22 | International Business Machines Corporation | Reads for dispersed computation jobs |
US9021499B2 (en) * | 2012-01-10 | 2015-04-28 | Hewlett-Packard Development Company, L.P. | Moving a logical device between processor modules in response to identifying a varying load pattern |
KR101827369B1 (ko) * | 2012-02-21 | 2018-02-09 | 한국전자통신연구원 | 데이터 스트림 분산 병렬 처리 서비스 관리 장치 및 방법 |
US20210382763A1 (en) * | 2012-03-02 | 2021-12-09 | Pure Storage, Inc. | Efficient Data Encoding And Processing In A Storage Network |
US9195684B2 (en) * | 2012-03-02 | 2015-11-24 | Cleversafe, Inc. | Redundant task execution in a distributed storage and task network |
WO2013137917A1 (en) * | 2012-03-15 | 2013-09-19 | Hewlett-Packard Development Company, L.P. | Determining a schedule for a job to replicate an object stored on a storage appliance |
US9672073B2 (en) * | 2012-06-07 | 2017-06-06 | Sybase, Inc. | Non-periodic check-pointing for fine granular retry of work in a distributed computing environment |
GB2505184A (en) * | 2012-08-21 | 2014-02-26 | Ibm | Checking data quality of an application program by monitoring runtime behaviour |
JP5965488B2 (ja) * | 2012-08-28 | 2016-08-03 | 株式会社日立システムズ | グリッド構成管理システムおよびグリッド構成管理方法 |
JP2014044677A (ja) * | 2012-08-28 | 2014-03-13 | Fujitsu Ltd | 送信制御プログラム、通信ノード、および送信制御方法 |
US9058215B2 (en) * | 2012-10-19 | 2015-06-16 | Sap Se | Integration of a calculation engine with a software component |
US9043644B2 (en) * | 2012-12-04 | 2015-05-26 | International Business Machines Corporation | Using separate processes to handle short-lived and long-lived jobs to reduce failure of processes |
US10552774B2 (en) * | 2013-02-11 | 2020-02-04 | Amazon Technologies, Inc. | Cost-minimizing task scheduler |
US20140244330A1 (en) * | 2013-02-22 | 2014-08-28 | Innovations 10.01, Llc | System and method for assessing and managing a facility |
US20140245319A1 (en) * | 2013-02-27 | 2014-08-28 | Greenbutton Limited | Method for enabling an application to run on a cloud computing system |
US20140278715A1 (en) * | 2013-03-15 | 2014-09-18 | International Business Machines Corporation | Estimating required time for process granularization |
US20140278640A1 (en) * | 2013-03-15 | 2014-09-18 | Companyons, Inc. | Business workflow management systems and methods |
US20140297234A1 (en) * | 2013-03-29 | 2014-10-02 | International Business Machines Corporation | Forecasting production output of computing system fabrication test using dynamic predictive model |
JP6209862B2 (ja) * | 2013-05-24 | 2017-10-11 | 富士通株式会社 | プログラム、ジョブ監視支援方法、情報処理装置およびシステム |
US20140358626A1 (en) * | 2013-06-04 | 2014-12-04 | Hewlett-Packard Development Company, L.P. | Assessing the impact of an incident in a service level agreement |
US9665386B2 (en) | 2013-06-14 | 2017-05-30 | Nutanix, Inc. | Method for leveraging hypervisor functionality for maintaining application consistent snapshots in a virtualization environment |
CN103336720B (zh) * | 2013-06-17 | 2016-07-06 | 湖南大学 | 一种基于slurm的具有数据依赖关系的作业执行方法 |
US9740514B1 (en) | 2013-06-26 | 2017-08-22 | Nutanix, Inc. | Method and system to share data with snapshots in a virtualization environment |
WO2014208139A1 (ja) | 2013-06-28 | 2014-12-31 | 日本電気株式会社 | 異常検出装置、制御方法、及びプログラム |
JP6236996B2 (ja) * | 2013-08-28 | 2017-11-29 | 富士通株式会社 | 情報処理装置および情報処理装置の制御方法 |
US9857974B2 (en) * | 2013-10-03 | 2018-01-02 | International Business Machines Corporation | Session execution decision |
US10496233B2 (en) * | 2013-10-23 | 2019-12-03 | Micro Focus Llc | Tracking a status of a process |
JP6221701B2 (ja) | 2013-12-03 | 2017-11-01 | 富士通株式会社 | 制御プログラム、制御装置及び制御方法 |
KR20150106233A (ko) * | 2014-03-11 | 2015-09-21 | 삼성전자주식회사 | 복수의 전자 장치에서 기능을 수행하는 방법 및 전자 장치 |
US11243707B2 (en) | 2014-03-12 | 2022-02-08 | Nutanix, Inc. | Method and system for implementing virtual machine images |
US9612878B2 (en) * | 2014-03-31 | 2017-04-04 | International Business Machines Corporation | Resource allocation in job scheduling environment |
JP2017520032A (ja) * | 2014-04-17 | 2017-07-20 | アビニシオ テクノロジー エルエルシー | 処理環境の統合監視および制御 |
US9959142B2 (en) * | 2014-06-17 | 2018-05-01 | Mediatek Inc. | Dynamic task scheduling method for dispatching sub-tasks to computing devices of heterogeneous computing system and related computer readable medium |
US9983901B2 (en) * | 2014-07-09 | 2018-05-29 | Google Llc | Dynamic shard allocation adjustment |
US9167047B1 (en) | 2014-09-24 | 2015-10-20 | Oracle International Corporation | System and method for using policies to support session recording for user account management in a computing environment |
US9148454B1 (en) * | 2014-09-24 | 2015-09-29 | Oracle International Corporation | System and method for supporting video processing load balancing for user account management in a computing environment |
US9830193B1 (en) | 2014-09-30 | 2017-11-28 | Amazon Technologies, Inc. | Automatic management of low latency computational capacity |
US9146764B1 (en) | 2014-09-30 | 2015-09-29 | Amazon Technologies, Inc. | Processing event messages for user requests to execute program code |
US9323556B2 (en) | 2014-09-30 | 2016-04-26 | Amazon Technologies, Inc. | Programmatic event detection and message generation for requests to execute program code |
US9600312B2 (en) | 2014-09-30 | 2017-03-21 | Amazon Technologies, Inc. | Threading as a service |
US10048974B1 (en) | 2014-09-30 | 2018-08-14 | Amazon Technologies, Inc. | Message-based computation request scheduling |
US9678773B1 (en) | 2014-09-30 | 2017-06-13 | Amazon Technologies, Inc. | Low latency computational capacity provisioning |
WO2016079802A1 (ja) * | 2014-11-18 | 2016-05-26 | 株式会社日立製作所 | バッチ処理システムおよびその制御方法 |
US9537788B2 (en) | 2014-12-05 | 2017-01-03 | Amazon Technologies, Inc. | Automatic determination of resource sizing |
US9588790B1 (en) | 2015-02-04 | 2017-03-07 | Amazon Technologies, Inc. | Stateful virtual compute system |
US9733967B2 (en) | 2015-02-04 | 2017-08-15 | Amazon Technologies, Inc. | Security protocols for low latency execution of program code |
WO2016132497A1 (ja) * | 2015-02-19 | 2016-08-25 | 株式会社日立製作所 | データ分析システム及びデータ分析方法 |
CA2987734A1 (en) | 2015-04-28 | 2016-11-03 | Solano Labs, Inc. | Cost optimization of cloud computing resources |
US9442770B1 (en) * | 2015-06-04 | 2016-09-13 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Workload execution timing device in a virtual machine environment |
US9606792B1 (en) * | 2015-11-13 | 2017-03-28 | International Business Machines Corporation | Monitoring communication quality utilizing task transfers |
US10379897B2 (en) * | 2015-12-14 | 2019-08-13 | Successfactors, Inc. | Adaptive job scheduling utilizing packaging and threads |
GB2545508B (en) | 2015-12-18 | 2019-04-10 | Imagination Tech Ltd | Controlling operation of a GPU |
KR101730271B1 (ko) | 2015-12-18 | 2017-04-25 | 한국과학기술원 | 복수의 모바일 단말간 에너지 소모 형평성을 고려한 태스크 최적 분배 기법 |
US9910713B2 (en) | 2015-12-21 | 2018-03-06 | Amazon Technologies, Inc. | Code execution request routing |
US10067801B1 (en) | 2015-12-21 | 2018-09-04 | Amazon Technologies, Inc. | Acquisition and maintenance of compute capacity |
US11132213B1 (en) | 2016-03-30 | 2021-09-28 | Amazon Technologies, Inc. | Dependency-based process of pre-existing data sets at an on demand code execution environment |
US10613947B2 (en) | 2016-06-09 | 2020-04-07 | Nutanix, Inc. | Saving and restoring storage devices using application-consistent snapshots |
AU2017276777B2 (en) * | 2016-06-10 | 2022-06-09 | Schneider Electric Industries Sas | Method and system for providing proxy service in an industrial system |
US10594798B2 (en) * | 2016-06-16 | 2020-03-17 | Veniam, Inc. | Systems and methods for managing containers in a network of moving things |
US10102040B2 (en) | 2016-06-29 | 2018-10-16 | Amazon Technologies, Inc | Adjusting variable limit on concurrent code executions |
US11240305B2 (en) * | 2016-07-28 | 2022-02-01 | At&T Intellectual Property I, L.P. | Task allocation among devices in a distributed data storage system |
US10430799B1 (en) * | 2017-02-03 | 2019-10-01 | Numerify, Inc. | System and method for determining a time threshold guarantee of a task for updating in a penalty clause of a service level agreement |
US10547673B2 (en) * | 2017-02-09 | 2020-01-28 | International Business Machines Corporation | Data and task reallocation in distributed computing platforms |
US10445140B1 (en) * | 2017-06-21 | 2019-10-15 | Amazon Technologies, Inc. | Serializing duration-limited task executions in an on demand code execution system |
US10725826B1 (en) * | 2017-06-21 | 2020-07-28 | Amazon Technologies, Inc. | Serializing duration-limited task executions in an on demand code execution system |
US10541939B2 (en) * | 2017-08-15 | 2020-01-21 | Google Llc | Systems and methods for provision of a guaranteed batch |
US10824522B2 (en) | 2017-11-27 | 2020-11-03 | Nutanix, Inc. | Method, apparatus, and computer program product for generating consistent snapshots without quiescing applications |
US10831898B1 (en) | 2018-02-05 | 2020-11-10 | Amazon Technologies, Inc. | Detecting privilege escalations in code including cross-service calls |
US10725752B1 (en) | 2018-02-13 | 2020-07-28 | Amazon Technologies, Inc. | Dependency handling in an on-demand network code execution system |
US10841397B2 (en) | 2018-04-17 | 2020-11-17 | Vmware, Inc. | Methods, apparatus, and systems to dynamically discover and host services in fog servers |
US10853115B2 (en) | 2018-06-25 | 2020-12-01 | Amazon Technologies, Inc. | Execution of auxiliary functions in an on-demand network code execution system |
US10649749B1 (en) | 2018-06-26 | 2020-05-12 | Amazon Technologies, Inc. | Cross-environment application of tracing information for improved code execution |
US11146569B1 (en) | 2018-06-28 | 2021-10-12 | Amazon Technologies, Inc. | Escalation-resistant secure network services using request-scoped authentication information |
US10949237B2 (en) | 2018-06-29 | 2021-03-16 | Amazon Technologies, Inc. | Operating system customization in an on-demand network code execution system |
US11099870B1 (en) | 2018-07-25 | 2021-08-24 | Amazon Technologies, Inc. | Reducing execution times in an on-demand network code execution system using saved machine states |
US11243953B2 (en) | 2018-09-27 | 2022-02-08 | Amazon Technologies, Inc. | Mapreduce implementation in an on-demand network code execution system and stream data processing system |
US11099917B2 (en) | 2018-09-27 | 2021-08-24 | Amazon Technologies, Inc. | Efficient state maintenance for execution environments in an on-demand code execution system |
US10884812B2 (en) | 2018-12-13 | 2021-01-05 | Amazon Technologies, Inc. | Performance-based hardware emulation in an on-demand network code execution system |
US11108640B2 (en) * | 2018-12-20 | 2021-08-31 | Advantest Corporation | Controlling devices in a decentralized storage environment |
US10810042B2 (en) * | 2019-01-18 | 2020-10-20 | Rubrik, Inc. | Distributed job scheduler with intelligent job splitting |
US11010188B1 (en) | 2019-02-05 | 2021-05-18 | Amazon Technologies, Inc. | Simulated data object storage using on-demand computation of data objects |
US11861386B1 (en) | 2019-03-22 | 2024-01-02 | Amazon Technologies, Inc. | Application gateways in an on-demand network code execution system |
US11119809B1 (en) | 2019-06-20 | 2021-09-14 | Amazon Technologies, Inc. | Virtualization-based transaction handling in an on-demand network code execution system |
US11494237B2 (en) * | 2019-06-26 | 2022-11-08 | Microsoft Technology Licensing, Llc | Managing workloads of a deep neural network processor |
US11190609B2 (en) | 2019-06-28 | 2021-11-30 | Amazon Technologies, Inc. | Connection pooling for scalable network services |
US11159528B2 (en) | 2019-06-28 | 2021-10-26 | Amazon Technologies, Inc. | Authentication to network-services using hosted authentication information |
US11115404B2 (en) | 2019-06-28 | 2021-09-07 | Amazon Technologies, Inc. | Facilitating service connections in serverless code executions |
CN111008073A (zh) * | 2019-11-22 | 2020-04-14 | 珠海格力电器股份有限公司 | 一种数据处理方法及装置 |
US11119826B2 (en) | 2019-11-27 | 2021-09-14 | Amazon Technologies, Inc. | Serverless call distribution to implement spillover while avoiding cold starts |
US11714682B1 (en) | 2020-03-03 | 2023-08-01 | Amazon Technologies, Inc. | Reclaiming computing resources in an on-demand code execution system |
GB2592609B (en) * | 2020-03-03 | 2023-05-31 | Imagination Tech Ltd | Resource allocation in a parallel processing system |
US11188391B1 (en) | 2020-03-11 | 2021-11-30 | Amazon Technologies, Inc. | Allocating resources to on-demand code executions under scarcity conditions |
US11775640B1 (en) | 2020-03-30 | 2023-10-03 | Amazon Technologies, Inc. | Resource utilization-based malicious task detection in an on-demand code execution system |
CN111641678A (zh) * | 2020-04-29 | 2020-09-08 | 深圳壹账通智能科技有限公司 | 任务调度方法、装置、电子设备及介质 |
US11550713B1 (en) | 2020-11-25 | 2023-01-10 | Amazon Technologies, Inc. | Garbage collection in distributed systems using life cycled storage roots |
US11593270B1 (en) | 2020-11-25 | 2023-02-28 | Amazon Technologies, Inc. | Fast distributed caching using erasure coded object parts |
US11388210B1 (en) | 2021-06-30 | 2022-07-12 | Amazon Technologies, Inc. | Streaming analytics using a serverless compute system |
CN113961351B (zh) * | 2021-10-28 | 2022-12-30 | 北京百度网讯科技有限公司 | 深度学习模型的分布式训练方法、装置、设备及存储介质 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0628323A (ja) | 1992-07-06 | 1994-02-04 | Nippon Telegr & Teleph Corp <Ntt> | プロセス実行制御方法 |
JPH09160884A (ja) | 1995-12-04 | 1997-06-20 | Mitsubishi Electric Corp | 動的負荷分散並列計算機 |
JPH09282288A (ja) | 1996-04-09 | 1997-10-31 | Fujitsu Ltd | 複数計算機運用システム |
US20020169680A1 (en) * | 2001-05-10 | 2002-11-14 | International Business Machines Corporation | Method and apparatus for building commercial distributed computing networks via computer cost subsidization |
JP2003099412A (ja) | 2001-09-21 | 2003-04-04 | Hitachi Eng Co Ltd | 超並列コンピュータ |
JP2005031771A (ja) | 2003-07-08 | 2005-02-03 | Hitachi Ltd | ジョブスケジューリング管理方法及びシステム並びにプログラム |
US7171531B2 (en) * | 2004-01-14 | 2007-01-30 | Hewlett-Packard Development Company, L.P. | Process job flow analysis |
JP2006100752A (ja) | 2004-09-30 | 2006-04-13 | Sanyo Electric Co Ltd | 回路装置およびその製造方法 |
JP4410661B2 (ja) | 2004-11-09 | 2010-02-03 | 株式会社日立製作所 | 分散制御システム |
US7849462B2 (en) * | 2005-01-07 | 2010-12-07 | Microsoft Corporation | Image server |
EP1862904A4 (en) | 2005-03-22 | 2009-06-03 | Fujitsu Ltd | DISTRIBUTED PROCESS MANAGEMENT DEVICE, DISTRIBUTED PROCESS MANAGEMENT METHOD, AND DISTRIBUTED PROCESS MANAGEMENT PROGRAM |
JP2006338264A (ja) | 2005-06-01 | 2006-12-14 | Toyota Infotechnology Center Co Ltd | タスク割当装置およびタスク割当方法 |
JP4370313B2 (ja) | 2006-07-10 | 2009-11-25 | 三菱電機株式会社 | 制御装置、制御装置のプロセス制御方法およびプロセス制御プログラム |
-
2006
- 2006-11-10 JP JP2006305614A patent/JP4308241B2/ja not_active Expired - Fee Related
-
2007
- 2007-11-01 US US11/933,725 patent/US8219997B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20080115143A1 (en) | 2008-05-15 |
US8219997B2 (en) | 2012-07-10 |
JP2008123205A (ja) | 2008-05-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4308241B2 (ja) | ジョブ実行方法、ジョブ実行システム及びジョブ実行プログラム | |
US7406689B2 (en) | Jobstream planner considering network contention & resource availability | |
Hamscher et al. | Evaluation of job-scheduling strategies for grid computing | |
KR101994506B1 (ko) | Paas 자원들, 작업들 및 스케줄링의 분리 기법 | |
JP6114829B2 (ja) | 仮想環境における演算インフラストラクチャのリアルタイム最適化 | |
JP6254949B2 (ja) | 仮想マシンプールにおけるリソースの価格設定 | |
US8095933B2 (en) | Grid project modeling, simulation, display, and scheduling | |
US7784056B2 (en) | Method and apparatus for scheduling grid jobs | |
US8468530B2 (en) | Determining and describing available resources and capabilities to match jobs to endpoints | |
KR101471749B1 (ko) | 클라우드 서비스의 가상자원 할당을 위한 퍼지 로직 기반의 자원평가 장치 및 방법 | |
CN106874084B (zh) | 一种分布式工作流调度的方法、装置及计算机设备 | |
EP3675434B1 (en) | Distributed system resource allocation method, device and system | |
WO2012066640A1 (ja) | 計算機システム、マイグレーション方法及び管理サーバ | |
KR20140109940A (ko) | Paas 계층적 스케일링 및 자동 스케일링 기법 | |
JP2012525641A (ja) | アプリケーション効率エンジン | |
Schulte et al. | Introducing the vienna platform for elastic processes | |
CN111443870B (zh) | 一种数据处理的方法、设备及存储介质 | |
CN107251007B (zh) | 集群计算服务确保装置和方法 | |
JP6620609B2 (ja) | 分散処理実行管理プログラム、分散処理実行管理方法および分散処理実行管理装置 | |
KR20070041462A (ko) | 유효자원 쿼럼 생성 모듈 기반 그리드 자원 관리 시스템 및그 방법 | |
Kumar et al. | Load balancing algorithm to minimize the makespan time in cloud environment | |
JP2007102332A (ja) | 負荷分散システム及び負荷分散方法 | |
JP6191361B2 (ja) | 情報処理システム、情報処理システムの制御方法及び制御プログラム | |
Burchard et al. | VRM: A failure-aware grid resource management system | |
Yau et al. | Distributed monitoring and adaptation of multiple qos in service-based systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20080708 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20081111 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20081202 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20090225 |
|
A602 | Written permission of extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A602 Effective date: 20090302 |
|
A521 | Written amendment |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20090331 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20090428 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20090430 |
|
R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120515 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120515 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130515 Year of fee payment: 4 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140515 Year of fee payment: 5 |
|
LAPS | Cancellation because of no payment of annual fees |