GB2601073B - Activation functions for Deep Neural Networks - Google Patents

Activation functions for Deep Neural Networks Download PDF

Info

Publication number
GB2601073B
GB2601073B GB2201358.5A GB202201358A GB2601073B GB 2601073 B GB2601073 B GB 2601073B GB 202201358 A GB202201358 A GB 202201358A GB 2601073 B GB2601073 B GB 2601073B
Authority
GB
United Kingdom
Prior art keywords
neural networks
deep neural
activation functions
activation
functions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
GB2201358.5A
Other versions
GB2601073A (en
GB202201358D0 (en
Inventor
Martin Chris
Tsichlas Antonios
Li Yuan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Imagination Technologies Ltd
Original Assignee
Imagination Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Imagination Technologies Ltd filed Critical Imagination Technologies Ltd
Priority to GB2201358.5A priority Critical patent/GB2601073B/en
Priority claimed from GB1718300.5A external-priority patent/GB2568087B/en
Publication of GB202201358D0 publication Critical patent/GB202201358D0/en
Publication of GB2601073A publication Critical patent/GB2601073A/en
Application granted granted Critical
Publication of GB2601073B publication Critical patent/GB2601073B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Neurology (AREA)
  • Image Processing (AREA)
GB2201358.5A 2017-11-03 2017-11-03 Activation functions for Deep Neural Networks Active GB2601073B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB2201358.5A GB2601073B (en) 2017-11-03 2017-11-03 Activation functions for Deep Neural Networks

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB2201358.5A GB2601073B (en) 2017-11-03 2017-11-03 Activation functions for Deep Neural Networks
GB1718300.5A GB2568087B (en) 2017-11-03 2017-11-03 Activation functions for deep neural networks

Publications (3)

Publication Number Publication Date
GB202201358D0 GB202201358D0 (en) 2022-03-16
GB2601073A GB2601073A (en) 2022-05-18
GB2601073B true GB2601073B (en) 2022-08-10

Family

ID=81289311

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2201358.5A Active GB2601073B (en) 2017-11-03 2017-11-03 Activation functions for Deep Neural Networks

Country Status (1)

Country Link
GB (1) GB2601073B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240112358A1 (en) * 2022-09-22 2024-04-04 Qualcomm Incorporated Deep learning model for high resolution predictions

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ASHKAN HOSSEINZADEH NAMIN ET AL, "Artificial neural networks activation function HDL coder", ELECTRO/INFORMATION TECHNOLOGY, 2009. EIT '09. IEEE INTERNATIONAL CONFERENCE ON, 1 June 2009, pages 389-392, XP055560834, Piscataway NJ, USA, ISBN:978-1-42443354-4 *

Also Published As

Publication number Publication date
GB2601073A (en) 2022-05-18
GB202201358D0 (en) 2022-03-16

Similar Documents

Publication Publication Date Title
GB2568087B (en) Activation functions for deep neural networks
IL271119A (en) Deep convolutional neural networks for variant classification
PL3459017T3 (en) Progressive neural networks
EP3628133C0 (en) Intra-group communication
GB2560387B (en) Action identification using neural networks
GB201718756D0 (en) Neural interface
EP3469522A4 (en) Accelerator for deep neural networks
EP3465550A4 (en) Accelerator for deep neural networks
GB201607713D0 (en) Convolutional neural network
GB201611857D0 (en) An artificial neural network
EP3123432A4 (en) Caching geolocated offers
EP3111718A4 (en) Establishing links between sub-nets
GB201609420D0 (en) Secure communications
IL263499B (en) Biarylmethyl heterocycles
ZAA201701760S (en) Razors
GB201512278D0 (en) Hybrid neural network
GB201608958D0 (en) Implantable neural interface
GB201603807D0 (en) Communication between applications
GB201802609D0 (en) Improved downlights
HK1251515A1 (en) Sideways forming
GB201609953D0 (en) Communication systems
GB2552583B (en) Communication event
GB2601073B (en) Activation functions for Deep Neural Networks
GB2603640B (en) Action identification using neural networks
GB201611699D0 (en) Behaviour modification