SG11202009486PA - Multi-task recurrent neural networks - Google Patents

Multi-task recurrent neural networks

Info

Publication number
SG11202009486PA
SG11202009486PA SG11202009486PA SG11202009486PA SG11202009486PA SG 11202009486P A SG11202009486P A SG 11202009486PA SG 11202009486P A SG11202009486P A SG 11202009486PA SG 11202009486P A SG11202009486P A SG 11202009486PA SG 11202009486P A SG11202009486P A SG 11202009486PA
Authority
SG
Singapore
Prior art keywords
neural networks
recurrent neural
task
task recurrent
networks
Prior art date
Application number
SG11202009486PA
Inventor
Milad Olia Hashemi
Jamie Alexander Smith
Kevin Jordan Swersky
Original Assignee
Google Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Llc filed Critical Google Llc
Publication of SG11202009486PA publication Critical patent/SG11202009486PA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/0223User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/0284Multiple user address space allocation, e.g. using different base addresses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0862Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with prefetch
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659Command handling arrangements, e.g. command buffers, queues, command scheduling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/60Details of cache memory
    • G06F2212/6024History based prefetching

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
  • Image Analysis (AREA)
  • Advance Control (AREA)
  • Executing Machine-Instructions (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Feedback Control In General (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Small-Scale Networks (AREA)
SG11202009486PA 2018-11-19 2019-11-15 Multi-task recurrent neural networks SG11202009486PA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862769512P 2018-11-19 2018-11-19
US16/262,785 US11416733B2 (en) 2018-11-19 2019-01-30 Multi-task recurrent neural networks
PCT/US2019/061780 WO2020106581A1 (en) 2018-11-19 2019-11-15 Multi-task recurrent neural networks

Publications (1)

Publication Number Publication Date
SG11202009486PA true SG11202009486PA (en) 2020-10-29

Family

ID=70726431

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202009486PA SG11202009486PA (en) 2018-11-19 2019-11-15 Multi-task recurrent neural networks

Country Status (10)

Country Link
US (1) US11416733B2 (en)
EP (1) EP3884391A1 (en)
JP (2) JP7057437B2 (en)
KR (2) KR102625762B1 (en)
CN (2) CN112970006B (en)
BR (1) BR112020020110A2 (en)
CA (1) CA3095205C (en)
SG (1) SG11202009486PA (en)
TW (2) TW202341009A (en)
WO (1) WO2020106581A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11494597B2 (en) * 2019-03-22 2022-11-08 Sri International Generative memory for lifelong machine learning
US11568246B2 (en) 2019-05-09 2023-01-31 Sri International Synthetic training examples from advice for training autonomous agents
US11586895B1 (en) * 2019-06-17 2023-02-21 Green Mountain Semiconductor, Inc. Recursive neural network using random access memory
US11151695B1 (en) * 2019-08-16 2021-10-19 Perceive Corporation Video denoising using neural networks with spatial and temporal features
TWI753630B (en) * 2020-10-13 2022-01-21 財團法人工業技術研究院 Classification device and classification method based on neural network
CN112528664B (en) * 2021-02-05 2021-04-27 湖南工商大学 Address matching method based on multi-task joint learning and address hierarchical structure knowledge
CN113705839B (en) * 2021-09-13 2023-10-20 北京博瑞华通科技有限公司 Predictive maintenance method and maintenance system for fuel cell stack
US12007899B2 (en) * 2021-09-30 2024-06-11 Micron Technology, Inc. Delta predictions for page scheduling
CN114268939B (en) * 2021-11-12 2024-03-08 重庆市中冉数字科技有限公司 Abnormal user identification method in mobile communication and intelligent device
CN116431315B (en) * 2023-06-07 2023-08-29 成都登临科技有限公司 Batch processing task processing method and device, electronic equipment and storage medium

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10171653A (en) * 1996-10-09 1998-06-26 Nkk Corp Branch estimation method for information processor and device using the method
US9141390B2 (en) * 2001-03-05 2015-09-22 Pact Xpp Technologies Ag Method of processing data with an array of data processors according to application ID
US7664644B1 (en) 2006-06-09 2010-02-16 At&T Intellectual Property Ii, L.P. Multitask learning for spoken language understanding
US8938655B2 (en) 2007-12-20 2015-01-20 Spansion Llc Extending flash memory data retension via rewrite refresh
US8200593B2 (en) * 2009-07-20 2012-06-12 Corticaldb Inc Method for efficiently simulating the information processing in cells and tissues of the nervous system with a temporal series compressed encoding neural network
JP2013537435A (en) * 2010-06-07 2013-10-03 アフェクティヴァ,インコーポレイテッド Psychological state analysis using web services
US8965819B2 (en) * 2010-08-16 2015-02-24 Oracle International Corporation System and method for effective caching using neural networks
US8683178B2 (en) 2011-01-21 2014-03-25 Apple Inc. Sharing a fault-status register when processing vector instructions
CN105264501B (en) * 2013-06-19 2018-06-08 英派尔科技开发有限公司 The method and apparatus for positioning the data being cached in multi-core processor
US9978014B2 (en) 2013-12-18 2018-05-22 Intel Corporation Reconfigurable processing unit
WO2015130928A1 (en) * 2014-02-26 2015-09-03 Nancy Packes, Inc. Real estate evaluating platform methods, apparatuses, and media
GB2541625A (en) 2014-05-23 2017-02-22 Datarobot Systems and techniques for predictive data analytics
TWI655587B (en) 2015-01-22 2019-04-01 美商前進公司 Neural network and method of neural network training
US10860837B2 (en) 2015-07-20 2020-12-08 University Of Maryland, College Park Deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition
US9336482B1 (en) * 2015-07-27 2016-05-10 Google Inc. Predicting likelihoods of conditions being satisfied using recurrent neural networks
US9652712B2 (en) 2015-07-27 2017-05-16 Google Inc. Analyzing health events using recurrent neural networks
US10546650B2 (en) * 2015-10-23 2020-01-28 Google Llc Neural network for processing aptamer data
KR102271262B1 (en) * 2015-11-12 2021-06-30 구글 엘엘씨 CGR Neural Networks
US10410113B2 (en) 2016-01-14 2019-09-10 Preferred Networks, Inc. Time series data adaptation and sensor fusion systems, methods, and apparatus
CN108780521B (en) 2016-02-04 2023-05-26 渊慧科技有限公司 Associated long-short term memory neural network layer
US10885426B2 (en) 2016-02-05 2021-01-05 Deepmind Technologies Limited Augmenting neural networks with external memory
US11783173B2 (en) 2016-06-23 2023-10-10 Microsoft Technology Licensing, Llc Multi-domain joint semantic frame parsing
TWI612488B (en) 2016-12-05 2018-01-21 財團法人資訊工業策進會 Computer device and method for predicting market demand of commodities
US10878314B2 (en) * 2017-03-09 2020-12-29 Alphaics Corporation System and method for training artificial intelligence systems using a SIMA based processor
US11354565B2 (en) * 2017-03-15 2022-06-07 Salesforce.Com, Inc. Probability-based guider
WO2018195459A1 (en) * 2017-04-20 2018-10-25 Google Llc Processing sequential data using recurrent neural networks
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10733380B2 (en) 2017-05-15 2020-08-04 Thomson Reuters Enterprise Center Gmbh Neural paraphrase generator
JP2019204335A (en) 2018-05-24 2019-11-28 株式会社日立製作所 Data processor and prefetch method
US20190370632A1 (en) * 2018-05-31 2019-12-05 Google Llc Computer system prediction machine learning models
US20200193268A1 (en) * 2018-12-14 2020-06-18 Advanced Micro Devices, Inc. Multi-instance recurrent neural network prediction

Also Published As

Publication number Publication date
EP3884391A1 (en) 2021-09-29
JP2022109919A (en) 2022-07-28
US20230033000A1 (en) 2023-02-02
KR102625762B1 (en) 2024-01-16
JP7494242B2 (en) 2024-06-03
US20200160150A1 (en) 2020-05-21
BR112020020110A2 (en) 2021-05-25
CA3095205A1 (en) 2020-05-28
CN112970006B (en) 2024-04-09
CN112970006A (en) 2021-06-15
JP7057437B2 (en) 2022-04-19
KR20240010548A (en) 2024-01-23
US11416733B2 (en) 2022-08-16
KR20200127028A (en) 2020-11-09
TW202341009A (en) 2023-10-16
WO2020106581A1 (en) 2020-05-28
JP2021525404A (en) 2021-09-24
CA3095205C (en) 2023-05-02
TW202020746A (en) 2020-06-01
TWI808219B (en) 2023-07-11
CN118170695A (en) 2024-06-11

Similar Documents

Publication Publication Date Title
SG11202009486PA (en) Multi-task recurrent neural networks
IL274424A (en) Meta-learning for multi-task learning for neural networks
GB201800836D0 (en) Recurrent deep convolutional neural network for object detection
PL3542316T3 (en) Attention-based sequence transduction neural networks
GB202205964D0 (en) API for recurrent neural networks
GB2560387B (en) Action identification using neural networks
EP3674984C0 (en) Set of neural networks
PL3810587T3 (en) Substituted alkoxypyridinyl indolsulfonamides
GB202205243D0 (en) Pose determination using one or more neural networks
GB201817893D0 (en) Predicting physological parameters
SI3793960T1 (en) Limewater
GB201814092D0 (en) Crowd Charge
GB201819540D0 (en) T cell modification
GB201821069D0 (en) Function approximation
GB2570742B (en) Optical-interference analysis
SG11202104554QA (en) Coating solution
GB201804451D0 (en) Artificial neural networks
GB201813762D0 (en) Neural interface
GB201803083D0 (en) Artificial Neural Networks
KR102209536B9 (en) Synaptic mechanotransistors
EP3752819C0 (en) Analyzer
GB201803571D0 (en) Component
GB201805973D0 (en) Neural network
GB201820463D0 (en) Electrochemical sythenesis
GB201813568D0 (en) Component