SG10201800154RA - Executing computational graphs on graphics processing units - Google Patents

Executing computational graphs on graphics processing units

Info

Publication number
SG10201800154RA
SG10201800154RA SG10201800154RA SG10201800154RA SG10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA
Authority
SG
Singapore
Prior art keywords
computational graph
processing units
graphics processing
executing
processing unit
Prior art date
Application number
SG10201800154RA
Inventor
Jingyue Wu
Christopher Daniel Leary
Original Assignee
Google Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Llc filed Critical Google Llc
Publication of SG10201800154RA publication Critical patent/SG10201800154RA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G06N3/105—Shells for specifying net layout
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Neurology (AREA)
  • Stored Programmes (AREA)
  • Devices For Executing Special Programs (AREA)
  • Image Processing (AREA)
  • Image Generation (AREA)

Abstract

EXECUTING COMPUTATIONAL GRAPHS ON GRAPHICS PROCESSING UNITS Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a data entity that causes a processing unit to process a computational graph. In one aspect, method includes the actions of receiving data identifying a computational graph, the computational graph including a plurality of nodes representing operations; obtaining compilation artifacts for processing the computational graph on a processing unit; and generating a data entity from the compilation artifacts, wherein the data entity, when invoked, causes the processing unit to process the computational graph by executing the operations represented by the plurality of nodes. FIG. 2
SG10201800154RA 2017-01-06 2018-01-05 Executing computational graphs on graphics processing units SG10201800154RA (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/400,937 US10325340B2 (en) 2017-01-06 2017-01-06 Executing computational graphs on graphics processing units

Publications (1)

Publication Number Publication Date
SG10201800154RA true SG10201800154RA (en) 2018-08-30

Family

ID=61190469

Family Applications (1)

Application Number Title Priority Date Filing Date
SG10201800154RA SG10201800154RA (en) 2017-01-06 2018-01-05 Executing computational graphs on graphics processing units

Country Status (6)

Country Link
US (3) US10325340B2 (en)
CN (2) CN108460458B (en)
DE (2) DE102018100258A1 (en)
GB (1) GB2560409A (en)
SG (1) SG10201800154RA (en)
WO (1) WO2018129366A1 (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2476226B (en) 2009-11-10 2012-03-28 Ingenia Holdings Ltd Optimisation
US10325340B2 (en) 2017-01-06 2019-06-18 Google Llc Executing computational graphs on graphics processing units
DE102018110687A1 (en) 2017-05-05 2018-11-08 Intel Corporation Dynamic accuracy management for deep learning integer primitives
CN109522521A (en) * 2018-11-16 2019-03-26 北京中创碳投科技有限公司 A kind of data processing method, device and computer equipment
KR102820745B1 (en) 2018-12-31 2025-06-13 삼성전자주식회사 Neural network system predicting polling time and neural network model processing method using the same
CN111459464B (en) * 2019-01-22 2023-04-25 阿里巴巴集团控股有限公司 Node fusion method, code generation method and device
CN111626398B (en) * 2019-02-28 2022-12-09 上海寒武纪信息科技有限公司 Operation method, device and related product
CN111667060B (en) * 2019-03-08 2022-12-09 上海寒武纪信息科技有限公司 Compilation method, device and related products of deep learning algorithm
CN111292223B (en) 2020-01-22 2023-07-25 北京百度网讯科技有限公司 Graph calculation processing method and device, electronic equipment and storage medium
US20220121904A1 (en) * 2020-10-16 2022-04-21 Ford Global Technologies, Llc Automated setup and communication coordination for training and utilizing massively parallel neural networks
CN112631605B (en) * 2020-12-31 2024-04-26 深圳前海微众银行股份有限公司 Code compiling method, device and equipment of federal learning model and storage medium
CN114004335B (en) * 2021-10-28 2025-07-01 上海商汤科技开发有限公司 A data processing method, device, electronic device and storage medium
US20230185634A1 (en) * 2021-12-13 2023-06-15 Nvidia Corporation Application programming interface to cause graph code to update a semaphore
CN119741186B (en) * 2025-03-04 2025-05-27 浙江智臾科技有限公司 A system and method for accelerating script calculation using a graphics processing unit

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4309756A (en) 1971-02-17 1982-01-05 Beckler Robert I Method of automatically evaluating source language logic condition sets and of compiling machine executable instructions directly therefrom
US6519767B1 (en) 1995-06-07 2003-02-11 Microsoft Corporation Compiler and method for automatically building version compatible object applications
US6311265B1 (en) * 1996-03-25 2001-10-30 Torrent Systems, Inc. Apparatuses and methods for programming parallel computers
US5844554A (en) 1996-09-17 1998-12-01 Bt Squared Technologies, Inc. Methods and systems for user interfaces and constraint handling configurations software
JP2001249949A (en) * 2000-03-07 2001-09-14 Nec Corp Feeling generation method, feeling generator and recording medium
US20050114850A1 (en) 2003-10-29 2005-05-26 Saurabh Chheda Energy-focused re-compilation of executables and hardware mechanisms based on compiler-architecture interaction and compiler-inserted control
US7996671B2 (en) 2003-11-17 2011-08-09 Bluerisc Inc. Security of program executables and microprocessors based on compiler-architecture interaction
US7343482B2 (en) 2004-10-20 2008-03-11 Arm Limited Program subgraph identification
US7954094B2 (en) 2006-03-27 2011-05-31 International Business Machines Corporation Method for improving performance of executable code
US20080276252A1 (en) * 2007-05-04 2008-11-06 Microsoft Corporation Kernel event visualization
CN101894051A (en) * 2010-07-29 2010-11-24 中国科学技术大学 CPU-GPU Cooperative Computing Method Based on Primary and Secondary Data Structure
BRPI1104413B1 (en) * 2011-09-19 2020-12-01 Universidade Estadual De Campinas - Unicamp gas leak detection system and method, method of determining the magnitude and location of gas leak through neural networks and use in rigid and / or flexible tubing
US8707314B2 (en) * 2011-12-16 2014-04-22 Advanced Micro Devices, Inc. Scheduling compute kernel workgroups to heterogeneous processors based on historical processor execution times and utilizations
US9332083B2 (en) * 2012-11-21 2016-05-03 International Business Machines Corporation High performance, distributed, shared, data grid for distributed Java virtual machine runtime artifacts
GB2510348A (en) * 2013-01-31 2014-08-06 Ibm Data transmissions using RDMA, data structures and fingerprints of the data structures
US11061539B2 (en) * 2013-03-15 2021-07-13 The Mathworks, Inc. Reference nodes in a computational graph
US9104432B2 (en) 2013-06-24 2015-08-11 International Business Machines Corporation Extracting stream graph structure in a computer language by pre-executing a deterministic subset
US9424079B2 (en) 2013-06-27 2016-08-23 Microsoft Technology Licensing, Llc Iteration support in a heterogeneous dataflow engine
CN104915187A (en) * 2014-03-13 2015-09-16 华为技术有限公司 Graph model calculation method and device
US20150363196A1 (en) 2014-06-13 2015-12-17 The Charles Stark Draper Laboratory Inc. Systems And Methods For Software Corpora
US9760406B2 (en) * 2014-09-02 2017-09-12 Ab Initio Technology Llc Controlling data processing tasks
CN105701506B (en) * 2016-01-12 2019-01-18 杭州电子科技大学 A kind of improved method based on transfinite learning machine and rarefaction representation classification
CN106055576B (en) * 2016-05-20 2018-04-10 大连理工大学 A kind of fast and effectively image search method under large-scale data background
US10325340B2 (en) 2017-01-06 2019-06-18 Google Llc Executing computational graphs on graphics processing units

Also Published As

Publication number Publication date
WO2018129366A1 (en) 2018-07-12
DE102018100258A1 (en) 2018-07-12
US20250086747A1 (en) 2025-03-13
DE202018100069U1 (en) 2018-04-09
CN108460458B (en) 2022-01-11
GB201800176D0 (en) 2018-02-21
US12190404B2 (en) 2025-01-07
CN114429201A (en) 2022-05-03
US20180197267A1 (en) 2018-07-12
US10325340B2 (en) 2019-06-18
GB2560409A (en) 2018-09-12
US20190287210A1 (en) 2019-09-19
CN108460458A (en) 2018-08-28

Similar Documents

Publication Publication Date Title
SG10201800154RA (en) Executing computational graphs on graphics processing units
EP4404531A3 (en) Placement and scheduling of radio signal processing dataflow operations
PH12019502894A1 (en) Automated response server device, terminal device, response system, response method, and program
PH12019502084A1 (en) Time-series data processing device, time-series data processing system, and time-series data processing method
SG10201800155PA (en) Loop and library fusion
PH12019501795A1 (en) Method and apparatus for writing service data into block chain and method for determining service subset
EP3054403A3 (en) Recurrent neural networks for data item generation
SA520420182B1 (en) Model-based parameter estimation for directional drilling in wellbore operations
MY194528A (en) Blockchain-based data processing method and device
MY191732A (en) Computer implemented system for generating assurance related planning process and documents for an entity and method thereof
WO2018035473A3 (en) Processing fundus images using machine learning models
EP4443424A3 (en) Contextual hotwords
SG10201709367UA (en) System of enclaves
WO2015195676A3 (en) Computer-implemented tools and methods for extracting information about the structure of a large computer software system, exploring its structure, discovering problems in its design, and enabling refactoring
GB2571651A (en) Systems for predictive data analytics, and related methods and apparatus
EP4425383A3 (en) Neural network system
MX2020012935A (en) Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device.
HK1213335A1 (en) System for metadata management
IE20210178A3 (en) Machine Learning Techniques For Predictive Prioritization
MY188125A (en) Image recognition system and method
EP2953065A3 (en) Generating representations of input sequences using neural networks
EP4446947A3 (en) Performing navigation tasks using grid codes
WO2016196435A3 (en) Segmentation techniques for learning user patterns to suggest applications responsive to an event on a device
SG10201807358YA (en) Workload automation and data lineage analysis
GB2554323A (en) Estimating computational resources for running data-mining services