SG10201800154RA - Executing computational graphs on graphics processing units - Google Patents

Executing computational graphs on graphics processing units

Info

Publication number
SG10201800154RA
SG10201800154RA SG10201800154RA SG10201800154RA SG10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA SG 10201800154R A SG10201800154R A SG 10201800154RA
Authority
SG
Singapore
Prior art keywords
computational graph
processing units
graphics processing
executing
processing unit
Prior art date
Application number
SG10201800154RA
Inventor
Jingyue Wu
Christopher Daniel Leary
Original Assignee
Google Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Llc filed Critical Google Llc
Publication of SG10201800154RA publication Critical patent/SG10201800154RA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G06N3/105—Shells for specifying net layout
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Neurology (AREA)
  • Stored Programmes (AREA)
  • Image Processing (AREA)
  • Devices For Executing Special Programs (AREA)
  • Image Generation (AREA)

Abstract

EXECUTING COMPUTATIONAL GRAPHS ON GRAPHICS PROCESSING UNITS Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a data entity that causes a processing unit to process a computational graph. In one aspect, method includes the actions of receiving data identifying a computational graph, the computational graph including a plurality of nodes representing operations; obtaining compilation artifacts for processing the computational graph on a processing unit; and generating a data entity from the compilation artifacts, wherein the data entity, when invoked, causes the processing unit to process the computational graph by executing the operations represented by the plurality of nodes. FIG. 2
SG10201800154RA 2017-01-06 2018-01-05 Executing computational graphs on graphics processing units SG10201800154RA (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/400,937 US10325340B2 (en) 2017-01-06 2017-01-06 Executing computational graphs on graphics processing units

Publications (1)

Publication Number Publication Date
SG10201800154RA true SG10201800154RA (en) 2018-08-30

Family

ID=61190469

Family Applications (1)

Application Number Title Priority Date Filing Date
SG10201800154RA SG10201800154RA (en) 2017-01-06 2018-01-05 Executing computational graphs on graphics processing units

Country Status (6)

Country Link
US (2) US10325340B2 (en)
CN (2) CN114429201A (en)
DE (2) DE102018100258A1 (en)
GB (1) GB2560409A (en)
SG (1) SG10201800154RA (en)
WO (1) WO2018129366A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102018110687A1 (en) 2017-05-05 2018-11-08 Intel Corporation Dynamic accuracy management for deep learning integer primitives
CN109522521A (en) * 2018-11-16 2019-03-26 北京中创碳投科技有限公司 A kind of data processing method, device and computer equipment
KR20200083048A (en) 2018-12-31 2020-07-08 삼성전자주식회사 Neural network system predicting polling time and neural network model processing method using the same
CN111459464B (en) * 2019-01-22 2023-04-25 阿里巴巴集团控股有限公司 Node fusion method, code generation method and device
CN111667060B (en) * 2019-03-08 2022-12-09 上海寒武纪信息科技有限公司 Deep learning algorithm compiling method and device and related products
CN111626398B (en) * 2019-02-28 2022-12-09 上海寒武纪信息科技有限公司 Operation method, device and related product
CN111292223B (en) * 2020-01-22 2023-07-25 北京百度网讯科技有限公司 Graph calculation processing method and device, electronic equipment and storage medium
CN112631605B (en) * 2020-12-31 2024-04-26 深圳前海微众银行股份有限公司 Code compiling method, device and equipment of federal learning model and storage medium

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4309756A (en) 1971-02-17 1982-01-05 Beckler Robert I Method of automatically evaluating source language logic condition sets and of compiling machine executable instructions directly therefrom
US6519767B1 (en) 1995-06-07 2003-02-11 Microsoft Corporation Compiler and method for automatically building version compatible object applications
US6311265B1 (en) * 1996-03-25 2001-10-30 Torrent Systems, Inc. Apparatuses and methods for programming parallel computers
US5844554A (en) 1996-09-17 1998-12-01 Bt Squared Technologies, Inc. Methods and systems for user interfaces and constraint handling configurations software
JP2001249949A (en) * 2000-03-07 2001-09-14 Nec Corp Feeling generation method, feeling generator and recording medium
US20050114850A1 (en) 2003-10-29 2005-05-26 Saurabh Chheda Energy-focused re-compilation of executables and hardware mechanisms based on compiler-architecture interaction and compiler-inserted control
US7996671B2 (en) 2003-11-17 2011-08-09 Bluerisc Inc. Security of program executables and microprocessors based on compiler-architecture interaction
US7343482B2 (en) 2004-10-20 2008-03-11 Arm Limited Program subgraph identification
US7954094B2 (en) 2006-03-27 2011-05-31 International Business Machines Corporation Method for improving performance of executable code
US20080276252A1 (en) * 2007-05-04 2008-11-06 Microsoft Corporation Kernel event visualization
CN101894051A (en) * 2010-07-29 2010-11-24 中国科学技术大学 Primary and secondary data structure-based CPU-GPU cooperative computing method
BRPI1104413B1 (en) * 2011-09-19 2020-12-01 Universidade Estadual De Campinas - Unicamp gas leak detection system and method, method of determining the magnitude and location of gas leak through neural networks and use in rigid and / or flexible tubing
US8707314B2 (en) * 2011-12-16 2014-04-22 Advanced Micro Devices, Inc. Scheduling compute kernel workgroups to heterogeneous processors based on historical processor execution times and utilizations
US9332083B2 (en) * 2012-11-21 2016-05-03 International Business Machines Corporation High performance, distributed, shared, data grid for distributed Java virtual machine runtime artifacts
GB2510348A (en) * 2013-01-31 2014-08-06 Ibm Data transmissions using RDMA, data structures and fingerprints of the data structures
US11061539B2 (en) * 2013-03-15 2021-07-13 The Mathworks, Inc. Reference nodes in a computational graph
US9104432B2 (en) 2013-06-24 2015-08-11 International Business Machines Corporation Extracting stream graph structure in a computer language by pre-executing a deterministic subset
US9424079B2 (en) 2013-06-27 2016-08-23 Microsoft Technology Licensing, Llc Iteration support in a heterogeneous dataflow engine
CN104915187A (en) * 2014-03-13 2015-09-16 华为技术有限公司 Graph model calculation method and device
WO2015191746A1 (en) 2014-06-13 2015-12-17 The Charles Stark Draper Laboratory, Inc. Systems and methods for a database of software artifacts
US9760406B2 (en) * 2014-09-02 2017-09-12 Ab Initio Technology Llc Controlling data processing tasks
CN105701506B (en) * 2016-01-12 2019-01-18 杭州电子科技大学 A kind of improved method based on transfinite learning machine and rarefaction representation classification
CN106055576B (en) * 2016-05-20 2018-04-10 大连理工大学 A kind of fast and effectively image search method under large-scale data background

Also Published As

Publication number Publication date
CN108460458A (en) 2018-08-28
US20190287210A1 (en) 2019-09-19
US10325340B2 (en) 2019-06-18
DE102018100258A1 (en) 2018-07-12
WO2018129366A1 (en) 2018-07-12
US20180197267A1 (en) 2018-07-12
CN114429201A (en) 2022-05-03
DE202018100069U1 (en) 2018-04-09
GB201800176D0 (en) 2018-02-21
GB2560409A (en) 2018-09-12
CN108460458B (en) 2022-01-11

Similar Documents

Publication Publication Date Title
SG10201800154RA (en) Executing computational graphs on graphics processing units
EP4404531A3 (en) Placement and scheduling of radio signal processing dataflow operations
PH12019501795A1 (en) Method and apparatus for writing service data into block chain and method for determining service subset
SG10201800155PA (en) Loop and library fusion
EP4242822A3 (en) Ensuring reproducibility in an artificial intelligence infrastructure
PH12019502084A1 (en) Time-series data processing device, time-series data processing system, and time-series data processing method
MX2019015040A (en) Automated response server device, terminal device, response system, response method, and program.
EP3054403A3 (en) Recurrent neural networks for data item generation
AR116476A1 (en) METHOD AND SYSTEM TO EXECUTE AUTOMATIC LEARNING ALGORITHMS
WO2018035473A3 (en) Processing fundus images using machine learning models
MY194528A (en) Blockchain-based data processing method and device
MX2019011590A (en) Methods and systems for testing web applications.
SG10201709367UA (en) System of enclaves
AR109633A1 (en) SYSTEMS TO ADJUST AGRONOMIC ENTRY DATA USING REMOTE DETECTION AND RELATED METHODS AND APPLIANCES
GB2571651A (en) Systems for predictive data analytics, and related methods and apparatus
WO2015195676A3 (en) Computer-implemented tools and methods for extracting information about the structure of a large computer software system, exploring its structure, discovering problems in its design, and enabling refactoring
CA2902821C (en) System for metadata management
EP4235462A3 (en) Depth concatenation using a matrix computation unit
MX2017009879A (en) Batch normalization layers.
MY188125A (en) Image recognition system and method
EP2953065A3 (en) Generating representations of input sequences using neural networks
WO2016196435A3 (en) Segmentation techniques for learning user patterns to suggest applications responsive to an event on a device
PH12021550063A1 (en) Image processing apparatus and method
SG10201807358YA (en) Workload automation and data lineage analysis
GB2554323A (en) Estimating computational resources for running data-mining services