SG10201804213UA - Projection neural networks - Google Patents

Projection neural networks

Info

Publication number
SG10201804213UA
SG10201804213UA SG10201804213UA SG10201804213UA SG10201804213UA SG 10201804213U A SG10201804213U A SG 10201804213UA SG 10201804213U A SG10201804213U A SG 10201804213UA SG 10201804213U A SG10201804213U A SG 10201804213UA SG 10201804213U A SG10201804213U A SG 10201804213UA
Authority
SG
Singapore
Prior art keywords
projection
layer
input
network
neural network
Prior art date
Application number
SG10201804213UA
Inventor
Sujith Ravi
Original Assignee
Google Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Llc filed Critical Google Llc
Publication of SG10201804213UA publication Critical patent/SG10201804213UA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology

Abstract

PROJECTIONNEURAL NETWORKS Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a projection neural network. In one aspect, a projection neural network is configured to receive a projection network input and to generate a projection network output from the projection network input. The projection neural network includes a sequence of one or more projection layers. Each projection layer has multiple projection layer parameters, and is configured to receive a layer input, apply multiple projection layer functions to the layer input, and generate a layer output by applying the projection layer parameters for the projection layer to the projection function outputs. [FIG. ] 28
SG10201804213UA 2017-05-20 2018-05-18 Projection neural networks SG10201804213UA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762509058P 2017-05-20 2017-05-20
US201762517635P 2017-06-09 2017-06-09

Publications (1)

Publication Number Publication Date
SG10201804213UA true SG10201804213UA (en) 2018-12-28

Family

ID=62528886

Family Applications (1)

Application Number Title Priority Date Filing Date
SG10201804213UA SG10201804213UA (en) 2017-05-20 2018-05-18 Projection neural networks

Country Status (5)

Country Link
US (2) US10748066B2 (en)
EP (1) EP3602413B1 (en)
CN (2) CN110651280B (en)
SG (1) SG10201804213UA (en)
WO (1) WO2018217563A1 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11170084B2 (en) 2018-06-28 2021-11-09 Private Identity Llc Biometric authentication
US11489866B2 (en) 2018-03-07 2022-11-01 Private Identity Llc Systems and methods for private authentication with helper networks
US11502841B2 (en) 2018-03-07 2022-11-15 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11138333B2 (en) 2018-03-07 2021-10-05 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11210375B2 (en) 2018-03-07 2021-12-28 Private Identity Llc Systems and methods for biometric processing with liveness
US11394552B2 (en) 2018-03-07 2022-07-19 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11789699B2 (en) 2018-03-07 2023-10-17 Private Identity Llc Systems and methods for private authentication with helper networks
US10721070B2 (en) 2018-03-07 2020-07-21 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11392802B2 (en) 2018-03-07 2022-07-19 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11265168B2 (en) 2018-03-07 2022-03-01 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US10938852B1 (en) 2020-08-14 2021-03-02 Private Identity Llc Systems and methods for private authentication with helper networks
US11797838B2 (en) 2018-03-13 2023-10-24 Pinterest, Inc. Efficient convolutional network for recommender systems
US10885277B2 (en) 2018-08-02 2021-01-05 Google Llc On-device neural networks for natural language understanding
US11657322B2 (en) * 2018-08-30 2023-05-23 Nec Corporation Method and system for scalable multi-task learning with convex clustering
US11568207B2 (en) * 2018-09-27 2023-01-31 Deepmind Technologies Limited Learning observation representations by predicting the future in latent space
US11868440B1 (en) * 2018-10-04 2024-01-09 A9.Com, Inc. Statistical model training systems
US20200202210A1 (en) * 2018-12-24 2020-06-25 Nokia Solutions And Networks Oy Systems and methods for training a neural network
CN111368996B (en) * 2019-02-14 2024-03-12 谷歌有限责任公司 Retraining projection network capable of transmitting natural language representation
US11694088B2 (en) * 2019-03-13 2023-07-04 Cortica Ltd. Method for object detection using knowledge distillation
WO2020182930A1 (en) * 2019-03-13 2020-09-17 Deepmind Technologies Limited Compressed sensing using neural networks
CN110111365B (en) * 2019-05-06 2022-04-15 深圳大学 Training method and device based on deep learning and target tracking method and device
US11231703B2 (en) * 2019-08-14 2022-01-25 Hitachi, Ltd. Multi task learning with incomplete labels for predictive maintenance
US20210374345A1 (en) * 2020-06-01 2021-12-02 Google Llc Processing large-scale textual inputs using neural networks

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5276771A (en) 1991-12-27 1994-01-04 R & D Associates Rapidly converging projective neural network
WO1999012085A2 (en) * 1997-09-04 1999-03-11 Camelot Information Technologies Ltd. Heterogeneous neural networks
JP3733711B2 (en) * 1997-10-27 2006-01-11 株式会社デンソー Simplified quasi-Newton projection calculation system, neural network learning system, recording medium, and signal processing apparatus
CN102393908B (en) * 2011-06-29 2013-07-17 湖南大学 Method for identifying three bottles on mixed production line based on machine vision detection
US9292787B2 (en) * 2012-08-29 2016-03-22 Microsoft Technology Licensing, Llc Computer-implemented deep tensor neural network
US20140156575A1 (en) 2012-11-30 2014-06-05 Nuance Communications, Inc. Method and Apparatus of Processing Data Using Deep Belief Networks Employing Low-Rank Matrix Factorization
US9519859B2 (en) * 2013-09-06 2016-12-13 Microsoft Technology Licensing, Llc Deep structured semantic model produced using click-through data
JP6612855B2 (en) * 2014-09-12 2019-11-27 マイクロソフト テクノロジー ライセンシング，エルエルシー Student DNN learning by output distribution
US10311375B2 (en) * 2014-10-16 2019-06-04 Nanyang Technological University Systems and methods for classifying electrical signals
CN104538028B (en) 2014-12-25 2017-10-17 清华大学 A kind of continuous speech recognition method that Recognition with Recurrent Neural Network is remembered based on depth shot and long term
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US9524716B2 (en) 2015-04-17 2016-12-20 Nuance Communications, Inc. Systems and methods for providing unnormalized language models
US10515307B2 (en) * 2015-06-05 2019-12-24 Google Llc Compressed recurrent neural network models
CN108369662A (en) * 2015-09-17 2018-08-03 南洋理工大学 Computer system including adaptive model and the method for training adaptive model
KR102492318B1 (en) * 2015-09-18 2023-01-26 삼성전자주식회사 Model training method and apparatus, and data recognizing method
US20170132528A1 (en) * 2015-11-06 2017-05-11 Microsoft Technology Licensing, Llc Joint model training
US9842106B2 (en) * 2015-12-04 2017-12-12 Mitsubishi Electric Research Laboratories, Inc Method and system for role dependent context sensitive spoken and textual language understanding with neural networks
MX2019000395A (en) * 2016-07-11 2019-08-05 Walmart Apollo Llc Systems and methods for facilitating product pickup by a friend or family member of the ordering customer.
US10839284B2 (en) * 2016-11-03 2020-11-17 Salesforce.Com, Inc. Joint many-task neural network model for multiple natural language processing (NLP) tasks
GB201620235D0 (en) * 2016-11-29 2017-01-11 Microsoft Technology Licensing Llc Neural network data entry system
US9990687B1 (en) * 2017-01-19 2018-06-05 Deep Learning Analytics, LLC Systems and methods for fast and repeatable embedding of high-dimensional data objects using deep learning with power efficient GPU and FPGA-based processing platforms

Also Published As

Publication number Publication date
CN110651280A (en) 2020-01-03
CN110651280B (en) 2023-06-06
US20180336472A1 (en) 2018-11-22
US10748066B2 (en) 2020-08-18
US11544573B2 (en) 2023-01-03
EP3602413A1 (en) 2020-02-05
CN116702843A (en) 2023-09-05
US20200349450A1 (en) 2020-11-05
EP3602413B1 (en) 2022-10-19
WO2018217563A1 (en) 2018-11-29

Similar Documents

Publication Publication Date Title
SG10201804213UA (en) Projection neural networks
EP4283526A3 (en) Dynamic task allocation for neural networks
EP3035250A3 (en) Large-scale classification in neural networks using hashing
AU2019101562A4 (en) Blockchain-based transaction processing method and apparatus
WO2015157718A3 (en) Parallelizing the training of convolutional neural networks
EP4242822A3 (en) Ensuring reproducibility in an artificial intelligence infrastructure
MX2017009879A (en) Batch normalization layers.
EP3654577A4 (en) Certificate management method, system, network device and computer readable storage medium
EP4266249A3 (en) Neural networks for facial modeling
CA2902821C (en) System for metadata management
EP4235514A3 (en) Methods, systems, articles of manufacture and apparatus to map workloads
EP4312157A3 (en) Progressive neurale netzwerke
WO2018218257A3 (en) A hierarchical computing network and methods thereof
WO2019046317A8 (en) Key data processing method and apparatus, and server
BR112019000541A2 (en) superpixel methods for convolutional neural networks
IE87469B1 (en) Image processing neural networks with separable convolutional layers
WO2016118206A3 (en) Neural networks for encrypted data
WO2019101227A3 (en) System and method for implementing blockchain-based digital certificates
EP3992857A4 (en) Method and device for generating neural network model, and computer-readable storage medium
WO2014146086A3 (en) Computer-based method and system of analyzing, editing and improving content
IL248306B (en) System and method for generating data sets for learning to identify user actions
WO2020035089A3 (en) System and method for blockchain-based decentralized application development
AU2018262455A1 (en) Systems and methods for scenario simulation
MX361806B (en) Methods and systems for recommending communications configurations.
EP4236422A3 (en) Devices and methods for discovering collectable data and analytics data in a network